Data Pipeline Engineer

2 days ago


Jamnagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
ETL Data Pipeline Specialist

We are seeking an experienced ETL data pipeline specialist to join our data engineering team.

About the Role

The successful candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data) and AWS Glue/Lambda for ingestion from varied sources.

Key Responsibilities
  • Design and develop ETL pipelines for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
Requirements
  • 4+ years of experience in ETL development with at least 1-2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
Preferred Qualifications
  • Experience with Collibra, BigID, or other metadata/governance tools.
  • Exposure to Data Mesh/Data Domain models.
  • AWS or Snowflake certification is a plus.


  • Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Description">We seek a seasoned Data Engineer to optimize our data infrastructure and deliver robust data pipelines.Key Responsibilities:">Design, implement, and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch protection rules and workflows to ensure...


  • Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer OpportunityWe are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of our robust data pipelines. As a key member of our team, you will be responsible for architecting end-to-end data pipelines, integrating third-party APIs, building data ingestion, storage, and transformation workflows,...


  • Jamnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerDeveloping and Maintaining Scalable Data Pipelines:The ideal candidate will be responsible for developing and maintaining scalable data pipelines to support increasing data volume and complexity.Key Responsibilities:Design efficient ETL pipelines following business requirements and development standards.Perform integration...

  • Cloud Data Engineer

    5 days ago


    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking skilled professionals to design, build, and manage robust data pipelines that power AI solutions. The role focuses on developing efficient workflows, ensuring data quality, security, and scalability to support AI/ML model training, inference, and intelligent decision-making processes.Key Responsibilities:Develop and...

  • Cloud Data Engineer

    1 week ago


    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a talented professional to lead the design and implementation of scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS services, including EMR, Glue, PySpark, Airflow, and Python.Requirements:A minimum of 5 years of experience in data engineering or related roles.Strong...


  • Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. This role requires expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using cloud services.Implement data ingestion, transformation, and...


  • Jamnagar, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 16,00,000

    About the RoleWe're looking for a highly skilled Data Engineering professional with expertise in building scalable data pipelines using AWS services.Key Responsibilities:Design and develop production-level data pipelines handling large volumes of structured and unstructured data.Own end-to-end ETL/ELT processes ensuring reliability, scalability, and high...


  • Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:Data Engineering PositionWe are seeking a highly skilled data engineer to fill this critical role. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines using ETL/ELT tools.


  • Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Pipeline DeveloperWe are seeking a skilled Data Pipeline Developer to join our team. The ideal candidate will have experience designing, developing, testing, and supporting data pipelines and applications using AWS services.The successful candidate will design and develop robust ETL pipelines using PySpark, focusing on performance,...


  • Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryWe are seeking a seasoned data engineer to design, build and optimize large-scale data pipelines using IBM DataStage.The ideal candidate will have hands-on experience in designing, building and optimizing complex data pipelines using IBM DataStage, along with strong SQL skills (Teradata).Key ResponsibilitiesData Pipeline Design and Development:...