Data Pipeline Specialist

4 days ago

Ajmer, Rajasthan, India beBeeEtl Full time ₹ 15,00,000 - ₹ 20,00,000
ETL Developer

We are seeking a skilled ETL professional to join our data engineering team. The ideal candidate will have expertise in designing, developing and maintaining scalable data pipelines using IBM DataStage and AWS Glue.

The successful applicant will collaborate with architects, business analysts and data modelers to ensure timely delivery of critical data assets supporting analytics and AI/ML use cases.

  • Key Responsibilities:
  • Design and develop ETL pipelines using IBM DataStage and AWS Glue for ingestion from varied sources.
  • B-build and optimize data flows for loading curated datasets into Snowflake.
  • Participate in code reviews, performance tuning and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
  • Required Skills and Experience:
  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage.
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning and performance tuning.
  • Proficiency in SQL, Unix scripting and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.
  • Good to Have:
  • Experience with Collibra, BigID or other metadata/governance tools.
  • Exposure to Data Mesh/Data Domain models.
  • Experience with agile/Scrum delivery and Jira/Confluence tools.
  • AWS or Snowflake certification is a plus.

  • Data Pipeline Specialist

    3 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking a highly skilled Data Engineer to design, build and maintain large-scale data pipelines. This individual will work with streaming data, collaborate with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design and optimize complex data pipelines using Spark and ETL workflows.Manage and process...

  • Data Pipeline Specialist

    1 day ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 18,95,000 - ₹ 25,10,000

    Our organization seeks a Senior Data Engineer to contribute to the design and development of scalable, high-performance data pipelines using Databricks and PySpark.This role is part of a dynamic team that collaborates with data scientists, analysts, and other engineering teams to support end-to-end data solutions. As a Senior Data Engineer, you will be...

  • Data Pipeline Specialist

    16 hours ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a self-motivated Data Engineer with 4-7 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The role involves working across scrum teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing.Strong...

  • Data Pipeline Quality Assurance Specialist

    13 hours ago

    Ajmer, Rajasthan, India beBeeTest Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionYou will play a key role in ensuring the accuracy, integrity, and performance of ETL pipelines deployed into cloud environments. Your task will be to develop and automate comprehensive test cases to validate data flows, transformations, and system behaviours using Python scripting and a popular testing framework.Key Responsibilities:Design and...

  • Chief Data Pipeline Architect

    13 hours ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled Data Engineer to join our data infrastructure team. As a key member of the team, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital product development.

  • Lead Data Specialist

    8 hours ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data Specialist Job DescriptionJob Title: Lead Data SpecialistJob Summary:We seek a skilled professional to lead the development of data pipelines and enhance data models for growing data volumes and complexity.Key Responsibilities:Develop scalable data architectures to support increasing data needs.Collaborate with business teams to improve data...

  • Data Engineering Specialist

    2 days ago

    Ajmer, Rajasthan, India beBeeDataEngineering Full time ₹ 1,68,00,000 - ₹ 2,28,00,000

    Job Title: Data Engineering SpecialistRole Overview: We are seeking an experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in designing and developing scalable data pipelines using cloud-based technologies such as Azure Databricks and Pyspark.Key Responsibilities:Develop and implement efficient data...

  • Senior Data Pipeline Engineer

    8 hours ago

    Ajmer, Rajasthan, India beBeeSoftware Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About the Role:We are seeking a highly experienced software engineer with expertise in designing and developing scalable data pipelines.Key Responsibilities:Architecture and Reuse:Design and develop reusable components for ingestion, parsing, extraction, validation, enrichment, and publishing of data.Define patterns/templates for data processing and...

  • Senior Data Architect

    13 hours ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Experienced Data ArchitectThe position of Senior Software Engineer/Technical Specialist is available in a remote setting. The ideal candidate should have at least 5 years of experience in developing and optimizing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.

  • Senior Data Integration Specialist

    2 days ago

    Ajmer, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job OverviewAs an experienced data integration specialist, you will work on developing, configuring, and troubleshooting large-scale data models, reference datasets, and integration workflows.Design and implement data pipelines using file-based, FTP/SFTP, API, real-time, and batch integrations.Develop and maintain reference datasets and support their...