Principal Data Pipeline Developer

2 weeks ago


Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 30,00,000
Job Title: Data Engineer - Azure

We are seeking a skilled Data Engineer with expertise in the Azure Data Platform to design, develop, and optimize large-scale data pipelines and analytics solutions.

  1. Develop and optimize data pipelines using Azure Data Factory (ADF) for ingestion into Azure Databricks (ADB).
  2. Implement PySpark transformations in Databricks with a focus on performance tuning.
  3. Build and maintain data layers (raw, curated, presentation) and ensure efficient export strategies for reporting and analytics.
  4. Work with Azure Synapse for advanced querying, transformations, and reporting.
  5. Configure and manage Azure Monitoring & Log Analytics for pipeline health, error handling, and automated alerts.
  6. Implement automation using Logic Apps and Azure Functions for workflow orchestration and integration.
  7. Ensure high-performance and scalable architecture across Databricks, Data Factory, and Synapse.

Key Skills:

  • Strong hands-on experience with Azure Databricks (PySpark, performance tuning, data modeling).
  • Proficiency in Azure Data Factory (ADF) – pipeline development, monitoring, troubleshooting.
  • Solid understanding of Azure Synapse Analytics (SQL Pools, performance optimization).
  • Experience with Azure Monitoring, Log Analytics, and error-handling frameworks.
  • Good knowledge of Logic Apps & Azure Functions for automation and orchestration.
  • Strong understanding of data architecture patterns (data lakes, data warehouses, reporting layers).


  • Pune, Maharashtra, India Michelin Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Principal Data Scientist KEY EXPECTED ACHIEVEMENTSBusiness understanding & Solution implementation• The business need is understood and formalized in a descriptive datasheet or specifications• The methods are identified through external researches and selected by their theoretical bases, advantages and drawbacks.• The results of the analysis or the...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Key ResponsibilitiesObtain business, functional, and technical specifications through interviewing and requirements gathering processes.Analyze and document these specifications, perform data analysis, support change management, training, and testing efforts.Collaborate with stakeholders to gather requirements on merging, de-duplicating, and standardizing...


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...

  • Data + AI Pipeline

    2 weeks ago


    Pune, Maharashtra, India VME Vhire Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    You will be a key member of the Data + AI Pipeline team, leading to the integration ofKubeflow, Kubernetes, Docker, Keda, and Python technologies. Your role will involvedeveloping and maintaining AI pipelines that support various projects, ensuring seamlessand efficient data processing, model training, and deployment. As part of a dynamic...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the Role : The Senior Data Engineer will be responsible for designing, developing and maintaining ETL pipelines using Azure Data Factory. The ideal candidate should have strong hands-on experience with Azure Data Factory (pipelines, triggers, linked services, datasets) as well as proficiency in T-SQL and SQL Server.Key Responsibilities :Design, develop...


  • Pune, Maharashtra, India beBeeDataScience Full time ₹ 19,62,000 - ₹ 23,49,000

    Job Description:We are seeking a highly skilled Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires strong expertise in CI/CD and Kubernetes to ensure seamless integration and scalability.Required Skills & Qualifications:Proven experience in designing and...

  • Data Analyst

    2 weeks ago


    Pune, Maharashtra, India Principal Global Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    ResponsibilitiesPerforming general analytics, statistical modeling on data sets in various areas of the business. Activities include data aggregation and insight development, analysis of data and presentation. Examines and identifies data patterns and trends to help answer business questions and improve decision making.QualificationsSKills:Beginner Data...

  • Data Analyst

    23 hours ago


    Pune, Maharashtra, India Principal Global Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    ResponsibilitiesPerforming general analytics, statistical modeling on data sets in various areas of the business. Activities include data aggregation and insight development, analysis of data and presentation. Examines and identifies data patterns and trends to help answer business questions and improve decision making.QualificationsSKills: ·   Beginner...


  • Pune, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    PySpark Developer Job Description We are seeking a highly skilled PySpark developer to join our team in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. Main Responsibilities: Develop and manage data pipelines using PySpark on...