Highly Skilled Data Pipeline Engineer

3 hours ago


Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000
Job Title: Data Pipeline Engineer

 

 

Job Description

We are seeking a highly skilled data pipeline engineer to drive the execution of testing strategies for our Databricks, Data Factory pipelines and Power BI projects.

 

The ideal candidate will have 5+ years of experience in data pipeline/ETL testing, with at least 2+ years as a Test Lead. They will be responsible for developing and executing comprehensive testing strategies for data pipelines using Python, SQL, etc.

 

They will also utilize JIRA test management to track and manage test cases, collaborate with development teams to ensure seamless integration of testing into Agile methodologies, design and implement automated tests using Git Hub/Bitbucket for version control and Jenkins for CI/CD automation.

 

Key Responsibilities:

  • Develop and execute comprehensive testing strategies for data pipelines.
  • Utilize JIRA test management to track and manage test cases.
  • Collaborate with development teams to ensure seamless integration of testing into Agile methodologies.
  • Design and implement automated tests using Git Hub/Bitbucket for version control and Jenkins for CI/CD automation.

 

Requirements:

  • 5+ years of experience in data pipeline/ETL testing.
  • At least 2+ years as a Test Lead.
  • Strong experience testing ETL workflows, SQL Data Warehouse, BI reports and dashboards.
  • Hands-on experience with X-Ray for JIRA test management, BDD (Cucumber, Spec Flow, or similar frameworks) and Dev Ops integration.
  • Excellent analytical, problem-solving, and communication skills.

 


  • Career Opportunity

    1 week ago


    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...


  • Chennai, Tamil Nadu, India beBeeDataPipeline Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline EngineerAbout the Role:Data Pipeline Engineer is a highly skilled technical professional responsible for designing, building, and maintaining complex data pipelines and workflows to move and transform data from various sources to destinations within the Azure ecosystem.Key Responsibilities:Design, build, and maintain complex data...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team on a contract basis.Job Description:As a Data Engineer, you will be responsible for designing, developing, and managing scalable and robust ETL pipelines using Azure Databricks and PySpark. You will collaborate with data scientists, analysts, and business stakeholders to...


  • Chennai, Tamil Nadu, India beBeeDataPipelineEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline EngineerWe are seeking a skilled data engineer to design, build, and optimize data pipelines using industry-leading technologies. The ideal candidate will have hands-on experience in developing ETL jobs and writing optimized SQL queries.About the Role:Design and develop data pipelines for large-scale data processing.Collaborate with...


  • Chennai, Tamil Nadu, India beBeeDataPlatform Full time ₹ 15,00,000 - ₹ 25,00,000

    About the Role We are looking for a highly skilled Data Platform Engineer to lead the design, development, and management of scalable data platforms and pipelines. This role demands a strong technical foundation in data architecture, big data technologies, and database systems (both SQL and NoSQL), along with the ability to work across functional teams to...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to spearhead our data-centric projects in Chennai. The ideal candidate will possess a strong background in software development with a focus on large-scale, data-driven applications.You will work with cutting-edge technologies in the Hadoop ecosystem, including Apache...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.Key Responsibilities:Design, develop, and maintain scalable and...


  • Chennai, Tamil Nadu, India beBeeBlockchain Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Backend Developer OpportunityAbout the Role:We are looking for a skilled Backend Developer to join our team. You'll play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges.This role is ideal for someone who enjoys low-level protocol work,...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled and motivated Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and managing scalable data pipelines.Key Responsibilities:Design and implement data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Composer, and...


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Senior Data Engineer Job OpportunityWe are looking for a highly skilled Senior Data Engineer to lead our team in developing efficient data pipelines, following best practices and standards.Key Responsibilities:Develop scalable ETL pipelines that meet business requirements and adhere to company standards.Perform thorough integration testing of created...