Lead Data Pipeline Specialist

2 weeks ago


Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

Key Role: Senior Data Engineer

  • We are seeking a highly skilled and experienced data professional to lead the migration, optimization, and governance of data pipelines in Azure Data Factory (ADF) and SQL.
  • The ideal candidate will have extensive experience in Change Data Capture (CDC), performance tuning, data security, and compliance within a cloud-based architecture.
  • Data Architecture and Optimization:
    • Architect and optimize CDC pipelines in ADF, Data Sync Services, and SQL to ensure efficient data ingestion.
    • Implement performance tuning strategies such as parallel processing, indexing, partitioning, and data archiving.
  • Data Security and Compliance:
    • Enforce security and compliance by implementing RBAC, data encryption, audit logging, and access control best practices.
  • Data Governance:
    • Define and implement data governance models, including roles, metadata management, and compliance policies.
  • Error Handling and Monitoring:
    • Develop robust error handling and monitoring with automated alerts, logging strategies, and retry mechanisms for CDC failures.
  • Technical Documentation:
    • Provide technical documentation and best practices for CDC implementation, security, and performance optimization.


  • Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Specialist - Data Pipeline EngineerAs a Big Data Specialist - Data Pipeline Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to efficiently curate and ingest data.Our ideal candidate will have strong SQL skills, experience with Fabric, and proficiency in programming languages such as Python (PySpark)....


  • Pune, Maharashtra, India beBeePipeline Full time ₹ 19,99,999 - ₹ 24,99,999

    Pipeline SpecialistAs a key member of our Pipelines team, you will be responsible for delivering pipeline engineering expertise to support the safe and reliable operation of our pipelines globally.Key Responsibilities:Regional Pipeline Support: Provide execution and assessment of subsea inspection campaigns and define repair requirements.Subsea and Pipeline...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Title: Data Architect SpecialistDescription:We are looking for a skilled Data Architect Specialist to craft and maintain robust data pipelines, utilizing Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data. This role involves building and optimizing data pipelines to facilitate seamless data flow across systems and...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role : The Senior Data Engineer will be responsible for designing, developing and maintaining ETL pipelines using Azure Data Factory. The ideal candidate should have strong hands-on experience with Azure Data Factory (pipelines, triggers, linked services, datasets) as well as proficiency in T-SQL and SQL Server.Key Responsibilities :Design, develop...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    As a Technical Specialist, you will play a pivotal role in designing, implementing, and managing data pipelines using Azure Data Factory.You will work closely with clients to understand their data needs and requirements, providing support and training on data tools and solutions.The ideal candidate will have 5-7 years of experience in data warehousing and...


  • Pune, Maharashtra, India beBeeOncology Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Specialist Oncology Global Commercial Pipeline AnalyticsAs a Senior Specialist in Oncology Global Commercial Pipeline Analytics, you will partner closely with cross-functional teams to drive innovation and excellence in the oncology pipeline.Key Responsibilities:Develop analytics capabilities to support strategic decision-making for the Global...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Job DescriptionPosition Overview:We're seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and supporting data transformation pipelines from Landing Zone to Consumption Layer, ensuring seamless operations in GCP and SAP BW environments.Key Responsibilities:Maintain and support data transformation...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...

  • Data + AI Pipeline

    2 weeks ago


    Pune, Maharashtra, India VME Vhire Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    You will be a key member of the Data + AI Pipeline team, leading to the integration ofKubeflow, Kubernetes, Docker, Keda, and Python technologies. Your role will involvedeveloping and maintaining AI pipelines that support various projects, ensuring seamlessand efficient data processing, model training, and deployment. As part of a dynamic...


  • Pune, Maharashtra, India beBeePipeline Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking an experienced Data Pipeline Quality Assurance specialist to join our data team.The ideal candidate will be proficient in analyzing source data, understanding data structures and distributions, and identifying anomalies to ensure data quality and readiness for processing.Key Responsibilities:Analyzing data pipelines and identifying areas for...