Senior Data Pipeline Developer

2 days ago

Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Senior Data Engineer – Data Pipelines

About the Role

We are seeking a highly skilled and experienced Senior Data Engineer to join our data engineering team. You will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.

Key Responsibilities

  • Create and implement ETL pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Collaborate with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.

Required Skills and Qualifications

To be successful in this role, you will need:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.

AWS or Snowflake certification is a plus, as well as experience with agile/Scrum delivery and Jira/Confluence tools.

This is an exciting opportunity to work on cutting-edge projects and collaborate with a talented team of engineers.

  • End-To-End Data Pipeline Developer

    3 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    At Xebia, we are seeking a skilled professional to join our team. The successful candidate will have expertise in building end-to-end data pipelines and delivering scalable data solutions on Azure.Key Responsibilities:Design, develop, and run complete E2E Data PipelinesHandle data validation, transformation, and warehousingCollaborate with stakeholders for...

  • High-Performance Data Pipeline Specialist

    2 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data EngineerWe are seeking a skilled Data Engineering Specialist with experience in designing and implementing scalable, high-performance data pipelines using cloud services like AWS and Databricks.Key Responsibilities:Design, develop, and maintain efficient data workflows using AWS and Databricks.Build and optimize ETL/ELT processes for large-scale...

  • AI Driven Data Pipelines Architect

    1 week ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    About Our PlatformWe are building a cutting-edge, AI-driven trading platform that ingests vast streams of financial, alternative, and sentiment data and transforms them into actionable insights for informed decision-making.Our mission is to integrate robust data engineering pipelines with Generative AI and advanced ML models to democratize access to...

  • Big Data Pipeline Specialist

    10 hours ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerJob Summary:We are seeking a skilled data engineer to fill this role at our organization. The ideal candidate will have 1–2 years of experience in data engineering and be proficient in building production-grade pipelines at scale.About the Role:Design, build, and maintain production-level data pipelines that handle terabytes of...

  • Senior Data Architect

    2 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000

    Job SummaryWe are seeking a highly skilled and experienced Senior Software Engineer/Technical Specialist to drive our data engineering initiatives. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Data Factory, Synapse, Fabric, and Databricks.The successful candidate will have a solid understanding of data...

  • Chief Data Pipeline Architect

    3 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering LeaderJob OverviewWe are seeking an experienced Data Engineering Leader to spearhead the design and implementation of end-to-end data pipelines and integration solutions. About YouA minimum of 8 years of experience in Technical, Solutioning, and Analytical roles.Strong understanding of Cloud platforms like Big Query or Redshift.Experience...

  • Senior Data Developer

    2 days ago

    Aurangabad, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Role Summary:We are seeking a seasoned Data Specialist to spearhead the development of complex data pipelines, collaborate with business stakeholders, and implement scalable data warehouse solutions.Job Description:This is an exciting opportunity to work on a hybrid role that involves designing and building robust ETL workflows using industry-leading tools...

  • Data Solutions Developer

    3 days ago

    Aurangabad, Maharashtra, India beBeeDataSolutions Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary\We are seeking a skilled Data Solutions Developer to join our team and contribute to the design, development, and maintenance of our data platform.As a key member of our implementation team, you will play a crucial role in building efficient data pipelines to extract, transform, and load data from various sources into our data lake and data...

  • Senior Data Scientist

    2 weeks ago

    Aurangabad, Maharashtra, India BayOne Solutions Full time

    About Role:We are seeking a Staff AI/ML Engineer & Data Scientist with deep expertise in traditional machine learning, Deep learning and strong MLOps experience to lead the design, deployment, and maintenance of production-grade ML systems. You will architect robust ML pipelines, apply advanced statistical techniques, and ensure models are accurate,...

  • Highly Skilled Senior Data Professional Wanted

    3 days ago

    Aurangabad, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Role Summary">We are seeking a highly skilled professional to fill the role of Senior Data Engineer. This is a remote-first opportunity that requires 4–5 years of experience in designing and implementing high-quality, secure, and scalable data pipelines and systems.">This position involves working with various tools such as Snowflake, Fivetran, DBT, and...