
Principal Data Pipeline Developer
2 weeks ago
We are seeking a skilled Data Engineer with expertise in the Azure Data Platform to design, develop, and optimize large-scale data pipelines and analytics solutions.
- Develop and optimize data pipelines using Azure Data Factory (ADF) for ingestion into Azure Databricks (ADB).
- Implement PySpark transformations in Databricks with a focus on performance tuning.
- Build and maintain data layers (raw, curated, presentation) and ensure efficient export strategies for reporting and analytics.
- Work with Azure Synapse for advanced querying, transformations, and reporting.
- Configure and manage Azure Monitoring & Log Analytics for pipeline health, error handling, and automated alerts.
- Implement automation using Logic Apps and Azure Functions for workflow orchestration and integration.
- Ensure high-performance and scalable architecture across Databricks, Data Factory, and Synapse.
Key Skills:
- Strong hands-on experience with Azure Databricks (PySpark, performance tuning, data modeling).
- Proficiency in Azure Data Factory (ADF) – pipeline development, monitoring, troubleshooting.
- Solid understanding of Azure Synapse Analytics (SQL Pools, performance optimization).
- Experience with Azure Monitoring, Log Analytics, and error-handling frameworks.
- Good knowledge of Logic Apps & Azure Functions for automation and orchestration.
- Strong understanding of data architecture patterns (data lakes, data warehouses, reporting layers).
-
Principal Data Scientist
1 week ago
Pune, Maharashtra, India Michelin Full time ₹ 15,00,000 - ₹ 20,00,000 per yearPrincipal Data Scientist KEY EXPECTED ACHIEVEMENTSBusiness understanding & Solution implementation• The business need is understood and formalized in a descriptive datasheet or specifications• The methods are identified through external researches and selected by their theoretical bases, advantages and drawbacks.• The results of the analysis or the...
-
Expert Data Pipeline Developer
2 weeks ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...
-
Senior Data Pipeline Developer
2 weeks ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Key ResponsibilitiesObtain business, functional, and technical specifications through interviewing and requirements gathering processes.Analyze and document these specifications, perform data analysis, support change management, training, and testing efforts.Collaborate with stakeholders to gather requirements on merging, de-duplicating, and standardizing...
-
Data Pipeline Architect
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...
-
Data + AI Pipeline
2 weeks ago
Pune, Maharashtra, India VME Vhire Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per yearYou will be a key member of the Data + AI Pipeline team, leading to the integration ofKubeflow, Kubernetes, Docker, Keda, and Python technologies. Your role will involvedeveloping and maintaining AI pipelines that support various projects, ensuring seamlessand efficient data processing, model training, and deployment. As part of a dynamic...
-
Data Pipelines Specialist
1 week ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000About the Role : The Senior Data Engineer will be responsible for designing, developing and maintaining ETL pipelines using Azure Data Factory. The ideal candidate should have strong hands-on experience with Azure Data Factory (pipelines, triggers, linked services, datasets) as well as proficiency in T-SQL and SQL Server.Key Responsibilities :Design, develop...
-
Data Pipeline Architect
5 days ago
Pune, Maharashtra, India beBeeDataScience Full time ₹ 19,62,000 - ₹ 23,49,000Job Description:We are seeking a highly skilled Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires strong expertise in CI/CD and Kubernetes to ensure seamless integration and scalability.Required Skills & Qualifications:Proven experience in designing and...
-
Data Analyst
2 weeks ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 8,00,000 - ₹ 12,00,000 per yearResponsibilitiesPerforming general analytics, statistical modeling on data sets in various areas of the business. Activities include data aggregation and insight development, analysis of data and presentation. Examines and identifies data patterns and trends to help answer business questions and improve decision making.QualificationsSKills:Beginner Data...
-
Data Analyst
23 hours ago
Pune, Maharashtra, India Principal Global Services Full time ₹ 8,00,000 - ₹ 12,00,000 per yearResponsibilitiesPerforming general analytics, statistical modeling on data sets in various areas of the business. Activities include data aggregation and insight development, analysis of data and presentation. Examines and identifies data patterns and trends to help answer business questions and improve decision making.QualificationsSKills: · Beginner...
-
Data Pipeline Architect
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000PySpark Developer Job Description We are seeking a highly skilled PySpark developer to join our team in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. Main Responsibilities: Develop and manage data pipelines using PySpark on...