Senior Data Pipeline Specialist

2 days ago


Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
ETL Lead with IBM DataStage

Design and develop scalable data pipelines using IBM DataStage on Cloud Pak for Data. This is a key role in our organization, requiring a seasoned ETL developer to collaborate with architects, business analysts, and data modelers.

  • Develop and maintain ETL pipelines using IBM DataStage and AWS Glue/Lambda.
  • Create and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.

As an ETL developer, you will work closely with cross-functional teams to ensure timely and accurate delivery of critical data assets supporting analytics and AI/ML use cases.

  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.

This role requires hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing, as well as 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).

Key Qualifications:
  • Strong understanding of data engineering principles and concepts.
  • Ability to work collaboratively with cross-functional teams.
  • Excellent problem-solving and analytical skills.


  • Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,40,000

    Job Title: Master Data Pipeline SpecialistAt diverse-lynx, we are seeking a highly skilled Data Engineer to design, develop, and maintain robust, scalable, and efficient data pipelines. Your primary responsibility will be to collect, process, and store structured and unstructured data from various sources.


  • Mumbai, Maharashtra, India beBeeDataGovernance Full time ₹ 1,75,00,000 - ₹ 2,50,00,000

    Technical Leadership OpportunityThis is a senior-level position that oversees the technical aspects of implementing data pipeline migration requirements, ensuring our platform is used to its full potential through designing and building applications around business stakeholder needs.Main ResponsibilitiesCollaborate directly with stakeholders to gather...


  • Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Transforming marketing data into actionable insights requires a unique blend of technical expertise and analytical thinking. As a key member of our data infrastructure team, you will design, develop, and maintain robust data pipelines, warehouses, and analytics platforms.Design and implement scalable data pipelines for marketing data ingestion and...


  • Mumbai, Maharashtra, India beBeeDataMigration Full time ₹ 25,00,000 - ₹ 35,00,000

    Job TitleThe primary role of the Senior Data Migration Specialist is to oversee the technical aspects of implementing data pipeline migration requirements.Main ResponsibilitiesEngage directly with stakeholders to gather key performance indicators and business needs.Possess comprehensive knowledge of functional and technical impact analysis, as well as...


  • Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Data Engineer OpportunityWe are seeking a skilled Data Engineer to design and develop scalable data pipelines.This role involves working with streaming data, collaborating with data scientists, and delivering high-quality solutions.


  • Mumbai, Maharashtra, India beBeeData Full time US$ 90,000 - US$ 1,20,000

    Job Title: Senior Data SpecialistWe are seeking a highly skilled Data Specialist to join our team.Job Description:The successful candidate will be responsible for designing and implementing scalable data pipelines using various tools such as Fabric, Pyspark notebooks, Spark SQL, and Python. They will work closely with the data engineering team to ensure that...


  • Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a highly skilled professional to build and maintain secure, scalable data pipelines using Databricks and Azure.This role requires expertise in handling ingestion from diverse sources (files, APIs, streaming), data transformation, and quality validation.The ideal candidate will collaborate with subsystem data science and product...


  • Mumbai, Maharashtra, India beBeeDataScience Full time ₹ 15,00,000 - ₹ 30,00,000

    We are seeking a detail-oriented and proactive professional to support the development and maintenance of data pipelines that fuel AI/ML initiatives.Key ResponsibilitiesCollaborate with cross-functional teams to translate business challenges into deployable AI solutionsImplement automated data labeling pipelines using techniques like active learning, weak...


  • Mumbai, Maharashtra, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAAs a...


  • Mumbai, Maharashtra, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...