Data Pipelines Specialist

4 hours ago


Pune, Maharashtra, India beBeeETL Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title

We are seeking a seasoned ETL Developer to spearhead the implementation of data pipelines in Azure Data Factory (ADF). The ideal candidate will design and develop comprehensive test plans, ensuring seamless integration and optimal performance of complex data workflows.

Key Responsibilities:

  • Design and develop manual and automated test cases for ADF using Python and Pytest to guarantee accurate data transformations and mappings.
  • Collaborate with cross-functional teams to understand ETL specifications and data flow requirements, utilizing expertise in SQL queries and data profiling.
  • Automate functional, regression, and performance tests of ETL workflows to ensure pipeline reliability and scalability.
  • Maintain test automation frameworks, leveraging Pytest fixtures and libraries to validate Azure data factory activities.

Required Skills:

  • Cloud: Microsoft Azure Data Factory
  • Testing Framework: Pytest
  • Languages: Python, SQL

About This Opportunity:

This role offers a unique chance to contribute to the development of innovative data solutions, working closely with experienced professionals who value collaboration, innovation, and customer satisfaction.


  • Data Pipeline Engineer

    13 hours ago


    Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Specialist - Data Pipeline EngineerAs a Big Data Specialist - Data Pipeline Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to efficiently curate and ingest data.Our ideal candidate will have strong SQL skills, experience with Fabric, and proficiency in programming languages such as Python (PySpark)....


  • Pune, Maharashtra, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 12,00,000

    We are seeking a skilled Data Pipeline Automation Specialist to join our team. The ideal candidate will have extensive experience in designing, developing and maintaining automated testing frameworks for large-scale data pipelines.The successful candidate will be responsible for ensuring the stability and quality of our data pipeline solutions.This is an...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data Architect SpecialistDescription:We are looking for a skilled Data Architect Specialist to craft and maintain robust data pipelines, utilizing Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data. This role involves building and optimizing data pipelines to facilitate seamless data flow across systems and...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role : The Senior Data Engineer will be responsible for designing, developing and maintaining ETL pipelines using Azure Data Factory. The ideal candidate should have strong hands-on experience with Azure Data Factory (pipelines, triggers, linked services, datasets) as well as proficiency in T-SQL and SQL Server.Key Responsibilities :Design, develop...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    As a Technical Specialist, you will play a pivotal role in designing, implementing, and managing data pipelines using Azure Data Factory.You will work closely with clients to understand their data needs and requirements, providing support and training on data tools and solutions.The ideal candidate will have 5-7 years of experience in data warehousing and...


  • Pune, Maharashtra, India beBeePipeline Full time ₹ 19,99,999 - ₹ 24,99,999

    Pipeline SpecialistAs a key member of our Pipelines team, you will be responsible for delivering pipeline engineering expertise to support the safe and reliable operation of our pipelines globally.Key Responsibilities:Regional Pipeline Support: Provide execution and assessment of subsea inspection campaigns and define repair requirements.Subsea and Pipeline...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Job DescriptionPosition Overview:We're seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and supporting data transformation pipelines from Landing Zone to Consumption Layer, ensuring seamless operations in GCP and SAP BW environments.Key Responsibilities:Maintain and support data transformation...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a key member of our team, you will play a pivotal role in designing, developing and maintaining data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform.The successful candidate will have deep expertise in data integration, ETL/ELT, APIs and Databricks. You will work closely with business...


  • Pune, Maharashtra, India beBeeCommercial Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:The Senior Specialist, Global Commercial Pharma Pipeline Analytics role is a pivotal position within the organization. The successful candidate will be responsible for developing and delivering data and analytics solutions to support strategic business decisions.This critical role requires a strong analytical mindset, excellent communication...