Data Pipeline Engineer

2 days ago


Chennai, Tamil Nadu, India beBeeDataPipelineEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Data Pipeline Engineer

We are seeking a skilled data engineer to design, build, and optimize data pipelines using industry-leading technologies. The ideal candidate will have hands-on experience in developing ETL jobs and writing optimized SQL queries.

About the Role:

  • Design and develop data pipelines for large-scale data processing.
  • Collaborate with data analysts and stakeholders to implement integration solutions.
  • Perform data validation and reconciliation tasks.
  • Conduct root cause analysis for data discrepancies and pipeline failures.
  • Develop reusable code components and follow best practices.
  • Monitor pipeline performance and manage dependencies.
  • Document workflows and data dictionaries.
  • Support cloud migration and integration initiatives.

Requirements:

  • IBM DataStage, Teradata, SQL, Oracle
  • Python, Shell Scripting, Unix/Linux, Apache Airflow, Cloud Platforms, Agile, CI/CD

Key Responsibilities:

Design, develop, and maintain ETL jobs using IBM DataStage. Write optimized SQL queries for data extraction, transformation, and validation. Collaborate with data analysts and business users to implement integration solutions. Perform manual and automated data validation and reconciliation.


  • Career Opportunity

    1 week ago


    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...


  • Chennai, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline EngineerAbout the Role:Data Pipeline Engineer is a highly skilled technical professional responsible for designing, building, and maintaining complex data pipelines and workflows to move and transform data from various sources to destinations within the Azure ecosystem.Key Responsibilities:Design, build, and maintain complex data...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    5 days ago


    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline Engineer  Job DescriptionWe are seeking a highly skilled data pipeline engineer to drive the execution of testing strategies for our Databricks, Data Factory pipelines and Power BI projects. The ideal candidate will have 5+ years of experience in data pipeline/ETL testing, with at least 2+ years as a Test Lead. They will be...


  • Chennai, Tamil Nadu, India beBeeBlockchain Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Backend Developer OpportunityAbout the Role:We are looking for a skilled Backend Developer to join our team. You'll play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges.This role is ideal for someone who enjoys low-level protocol work,...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Responsibilities:We are seeking a seasoned data engineering professional to lead the design and development of robust data pipelines using Azure Data Factory.Collaborate with cross-functional teams to identify complex data requirements and deliver tailored solutions that meet business objectives.Stay updated on the latest Azure Data Factory features and...

  • Data Engineer

    4 days ago


    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...


  • Chennai, Tamil Nadu, India beBeeDataScientist Full time ₹ 10,00,000 - ₹ 15,00,000

    About this role : You will be creating, maintaining and supporting data pipelines with information coming from various sources. This includes vessels, projects, campaigns, third-party data services and more. You will play a key role in organizing data, developing and maintaining data models and designing modern data solutions and products on our cloud...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and managing scalable data pipelines.Key Responsibilities:Design and implement data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Composer, and...