Senior ETL Data Pipeline Engineer

2 weeks ago

Davangere, Karnataka, India beBeeData Full time ₹ 19,50,000 - ₹ 25,95,000
Senior ETL Data Pipeline Engineer

As a seasoned Senior ETL Data Pipeline Engineer, you will be responsible for designing and developing scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.

Key Responsibilities:

  • Design and implement efficient data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Collaborate with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Develop and optimize ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources.

Requirements:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.

Benefits:

  • Opportunity to work with cutting-edge technologies like IBM DataStage and AWS Glue.
  • Chance to develop skills in cloud-based data warehousing and big data analytics.
  • Collaborative and dynamic work environment.

Others:

We are looking for someone who is passionate about data engineering and has a strong desire to learn and grow. If you are a motivated and talented professional with a passion for building scalable data pipelines, we encourage you to apply.

  • Senior Data Pipeline Engineer

    2 weeks ago

    Davangere, Karnataka, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data ArchitectOverview:Our organization seeks a skilled and motivated professional to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data.Key Responsibilities:Design and implement robust data pipelines for processing complex data structures.Build and maintain ETL/ELT...

  • Designing Robust Data Pipelines

    5 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Senior Data Engineering RoleCrafted solutions drive business forward by harnessing the power of data. As a Senior Data Engineer, your expertise will be pivotal in designing and refining intricate data pipelines to inform strategic decisions.Create and enhance ETL workflows for efficient processing of large datasets.Maintain data accuracy, consistency, and...

  • Senior Cloud Data Engineering Specialist

    6 days ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Opportunity OverviewWe are seeking a skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience with GCP and ETL, as well as a strong background in data warehousing and database management.The successful candidate will be responsible for designing, building, and maintaining large-scale data pipelines on GCP, using tools...

  • Senior Data Pipeline Specialist

    7 days ago

    Davangere, Karnataka, India beBeePipeline Full time ₹ 12,00,000 - ₹ 17,00,000

    Job Overview:The role of a Data Pipeline Architect involves designing and implementing scalable data solutions using Python and GCP services. This full-time position requires an experienced professional to lead the development and deployment of reliable datasets and insights.Key Responsibilities:Data Solution Design: Develop scalable data solutions using...

  • Senior Data Specialist

    7 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Senior Data EngineerOur organization is seeking a highly skilled Senior Data Engineer to work in an on-premise data engineering environment. The ideal candidate will have expertise in designing, developing, and optimizing ETL pipelines using open-source or cloud ETL tools.This role involves working with large datasets and leveraging big data technologies...

  • Senior Data Engineering Expert

    1 week ago

    Davangere, Karnataka, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 2,00,000

    Job Overview:We are seeking a seasoned Senior Data Engineer with deep expertise in AWS Cloud Development to lead the development of new data products and modernization of existing platforms.This individual will design, build, and optimize large-scale data pipelines and architectures in both on-premises environments (e.g., Oracle) and cloud environments...

  • Senior Data Engineering Strategist

    5 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Senior Data Engineering StrategistDescription – Lead the development and implementation of high-quality data ingestion, validation, and quality control processes using AI-enhanced frameworks.We are seeking a seasoned data engineering leader with a strong foundation in data pipelines, data validation, and AI-enhanced quality frameworks to join...

  • Chief Data Engineering Architect

    2 weeks ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Engineer SMEThis role involves the design, development, and maintenance of a modern data platform that supports analytics and reporting capabilities.The ideal candidate will have deep technical expertise in ETL pipeline design, data modeling, and data infrastructure. They must be able to thrive in a fast-paced, engineering-driven...

  • Senior Data Engineering Expert

    2 weeks ago

    Davangere, Karnataka, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,50,000

    Job Title:Senior Data Engineering Expert">About the Role:We are seeking a seasoned Senior Data Engineer to lead the design and implementation of high-quality, secure, and scalable data pipelines and systems.This role requires 4–5 years of experience in data engineering with expertise in designing complex data architectures and developing efficient data...

  • Data Pipeline Architect

    6 days ago

    Davangere, Karnataka, India beBeeDataSystems Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Data Systems EngineerWe are seeking skilled professionals to design, develop, and maintain robust data pipelines that power cloud-native solutions.Main Responsibilities:Design, build, and manage ETL/ELT workflows in cloud environments.Leverage AWS services for scalable data ingestion, transformation, storage, and querying.Ensure robust data...