Data Pipeline Specialist

6 days ago

Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Description

We are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines.

The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.

  • Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.
  • Build automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborate with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
  • Work closely with cross-functional teams (analysts, product managers, engineers) to define and implement data requirements.
  • Ensure thorough documentation and knowledge sharing across stakeholders.

  • Data Pipeline Architect

    5 days ago

    Alleppey, Kerala, India beBeeDataIntegration Full time ₹ 9,87,654 - ₹ 12,34,567

    Freelance Data Integration SpecialistWe are seeking an experienced Freelance Data Integration Specialist to support our data integration and ETL needs.Key Responsibilities:Design, build, and maintain data pipelines for ETL processes.Integrate data from multiple sources (on-premise, cloud, structured, and unstructured).Optimize pipelines for performance,...

  • Senior Data Pipeline Specialist

    6 days ago

    Alleppey, Kerala, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000

    Data Engineering RoleAbout the Role:We are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines using Python and AWS services.Develop and maintain scalable data pipelines that extract, transform, and load data into various data stores, ensuring...

  • Senior Financial Data Pipeline Specialist

    6 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 14,50,000

    Job OverviewWe are seeking a skilled Data Engineer to join our team and contribute to the design, development, and maintenance of robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and implement end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets using distributed data systems.Integrate...

  • Data Pipeline Architectural Specialist

    1 week ago

    Alleppey, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a candidate who is comfortable working in a dynamic environment with diverse time zones.The ideal candidate will have hands-on technical skills combined with leadership qualities to guide junior engineers, ensure best practices, and deliver high-quality data solutions.Key ResponsibilitiesLead and support testing efforts for data...

  • Senior Data Pipeline Developer

    7 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking an experienced data pipeline developer with expertise in building and managing large-scale data processing jobs, continuous integration/deployment pipelines, and multi-environment deployments.

  • Chief Data Pipeline Architect

    7 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Unlock Your Potential in Data EngineeringJob OverviewWe seek a skilled professional to design, build, and manage scalable data pipelines and enterprise data solutions. The ideal candidate will possess expertise in Azure, SQL Server, and Databricks.This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering...

  • Chief Data Pipeline Architect

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 2,59,20,000

    Job Title: Data EngineerRole Overview:The ideal candidate will play a pivotal role in designing and implementing scalable data pipelines using Microsoft Fabric.Design and implement data pipelines utilizing data engineering principles.Key Responsibilities:Develop ETL/ELT solutions using PySpark and T-SQL.Manage and optimize data storage and compute...

  • Data Engineer for Cloud Pipelines

    2 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 72,00,000 - ₹ 1,24,00,000

    About us: We empower clients to transform data into valuable insights by leveraging cloud-based technologies. Our goal is to deliver innovative solutions that drive business outcomes.We operate globally, serving major industries such as Banking, Financial Services & Insurance (BFSI), Technology, Media & Telecommunications (TMT), Healthcare & Life Sciences,...

  • Cloud Data Specialist

    6 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistWe are seeking a highly skilled and experienced Cloud Data Specialist to design and develop scalable data processing workflows using Azure Cloud technologies, Python, Scala, Spark (PySpark & Scala Spark), and data management principles.Key Responsibilities:Design and Develop Efficient ETL Pipelines: Create optimized ETL...

  • Senior Data Pipeline Architect

    6 days ago

    Alleppey, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:As a data engineer, you will play a pivotal role in building and maintaining our data infrastructure. This involves working closely with our data science team to design and implement complex algorithms that provide valuable insights into our data.You will be responsible for modeling front-end and back-end data sources to draw a comprehensive...