Data Pipeline Engineer

1 day ago

Ajmer, Rajasthan, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Description">

As a skilled ETL Developer, you will play a crucial role in designing and implementing efficient data pipelines using IBM DataStage and AWS Glue/Lambda.

Key responsibilities include:

  • Designing and developing ETL pipelines for ingesting data from various sources like flat files, APIs, Oracle, and DB2.
  • Building and optimizing data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participating in code reviews, performance tuning, and defect triage sessions to ensure high-quality deliverables.
  • Collaborating with data governance teams to embed lineage, privacy tagging, and quality controls within pipelines.

Required Skills and Qualifications

You should have at least 4 years of experience in ETL development with hands-on experience in IBM DataStage (CP4D version) and AWS Glue (PySpark or Spark). Additionally, proficiency in SQL, Unix scripting, and basic Python is necessary. Familiarity with S3, version control systems (Git), and job orchestration tools is also required.

Experience

Experience working with Snowflake, including loading strategies, stream-task, zero-copy cloning, and performance tuning, is essential. Proficiency in data profiling, cleansing, and quality validation routines is also necessary.

Education and Certifications

A degree in Computer Science or related field and relevant certifications (e.g., AWS or Snowflake) are highly valued.

Additional Information

This position requires strong communication and teamwork skills. Agile delivery practices, sprint planning, and documentation requirements are also essential.

  • Data Pipeline Specialist

    7 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Data Engineer to design, build and maintain large-scale data pipelines. This individual will work with streaming data, collaborate with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design and optimize complex data pipelines using Spark and ETL workflows.Manage and process...

  • Software Engineer

    3 days ago

    Ajmer, Rajasthan, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 25,00,000

    Python DeveloperWe are seeking a highly skilled Python developer to spearhead the design and implementation of automated data pipelines using cloud-based services.Key Responsibilities:Design and implement data pipelines leveraging cloud-based technologiesDevelop analytical algorithms to drive business insightsBuild REST APIs for seamless data...

  • Data Pipeline Specialist

    6 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 18,95,000 - ₹ 25,10,000

    Our organization seeks a Senior Data Engineer to contribute to the design and development of scalable, high-performance data pipelines using Databricks and PySpark.This role is part of a dynamic team that collaborates with data scientists, analysts, and other engineering teams to support end-to-end data solutions. As a Senior Data Engineer, you will be...

  • Cloud Data Pipeline Specialist

    1 day ago

    Ajmer, Rajasthan, India beBeeDataEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Seeking a Data Engineering expert to build and maintain robust data pipelines using cloud-based technologies.Key Responsibilities:Design, develop and maintain scalable data pipelines using cloud services.Implement data ingestion, transformation and storage solutions.Ensure data quality, integrity and security across all data systems.Monitor and troubleshoot...

  • Chief Data Pipeline Architect

    3 days ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Responsibilities:Design, develop, and maintain scalable data pipelines using cloud services (GCP, AWS, or...

  • Principal Data Pipeline Specialist

    1 day ago

    Ajmer, Rajasthan, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 50,00,000

    Job SummaryDesign and build production-level data pipelines to handle large volumes of structured and unstructured data.Ensure the reliability, scalability, and high availability of end-to-end ETL/ELT processes.Work with AWS services (S3, EC2, RDS, DynamoDB, Athena, Redshift) to power large-scale data workflows.Collaborate closely with AI/ML teams to support...

  • Senior Data Pipeline Engineer

    5 days ago

    Ajmer, Rajasthan, India beBeeSoftware Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About the Role:We are seeking a highly experienced software engineer with expertise in designing and developing scalable data pipelines.Key Responsibilities:Architecture and Reuse:Design and develop reusable components for ingestion, parsing, extraction, validation, enrichment, and publishing of data.Define patterns/templates for data processing and...

  • Data Engineer – Pipeline Specialist

    4 days ago

    Ajmer, Rajasthan, India beBeedataengineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    ">Design and Develop Data Pipelines with Python">

  • Data Pipeline Specialist

    1 week ago

    Ajmer, Rajasthan, India beBeeEtl Full time ₹ 15,00,000 - ₹ 20,00,000

    ETL DeveloperWe are seeking a skilled ETL professional to join our data engineering team. The ideal candidate will have expertise in designing, developing and maintaining scalable data pipelines using IBM DataStage and AWS Glue.The successful applicant will collaborate with architects, business analysts and data modelers to ensure timely delivery of critical...

  • Chief Data Pipeline Architect

    5 days ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to join our data infrastructure team. As a key member of the team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital product development.