Azure Databricks Technical Lead
13 hours ago
The ideal candidate for this role will have a minimum of 5 years of experience architecting and building data platforms on Azure. With expertise in Azure Databricks, PySpark, and SQL, the selected individual will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks.
Our estimate for the salary range for this position is between ₹18,00,000 - ₹30,00,000 per annum, based on national averages and industry standards.
About the Job:- We are seeking a highly skilled professional to lead our team in designing and implementing scalable data processing pipelines using Azure Databricks and PySpark.
- The successful candidate will be responsible for creating ETL processes to ingest, transform, and load data from various sources and collaborating with data engineers and architects to ensure efficient data movement and transformation.
- Data Pipeline Design and Development:
Create data processing pipelines that can handle large volumes of data and provide high performance. - Data Quality Implementation:
Implement data quality checks and validation rules within Azure Databricks and monitor data quality metrics. - Unity Catalog Integration:
Integrate Azure Databricks Unity Catalog to manage metadata, tables, and views. - Delta Lake Expertise:
Understand and utilize Delta Lake for reliable data storage and versioning. - Performance Tuning and Query Optimization:
Analyze query performance and optimize SQL queries, Spark jobs, and transformations for efficiency. - Resource Optimization:
Manage compute resources effectively within Azure Databricks clusters. - Source System Integration:
Integrate Azure Databricks with various source systems.
- Bachelor's degree in computer science or a related field.
- Minimum 5 years of experience architecting and building data platforms on Azure.
- Proficiency in Azure Databricks, PySpark, and SQL.
- Familiarity with Delta Lake concepts.
-
Lead Data Engineer for Azure Databricks
13 hours ago
Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full timeJob Title: Lead Data Engineer for Azure DatabricksWe are seeking an experienced Lead Data Engineer to join our team at Hoonar Tekwurks Private Limited. The ideal candidate will have a strong background in designing and implementing data solutions using Azure Databricks and a minimum of 5 years of experience working with data platforms on Azure.Our estimated...
-
Data Engineer
7 days ago
Pune, Maharashtra, India LTIMindtree Full timeAbout the RoleWe are seeking an experienced Data Engineer with expertise in Azure Databricks to join our team at LTIMindtree.Key ResponsibilitiesDesign, construct, install, test, and maintain highly scalable data management systems using Azure DatabricksDevelop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks...
-
Azure Databricks Engineer
1 week ago
Pune, Maharashtra, India LTIMindtree Full timeAzure Databricks Job DescriptionLTIMindtree is a leading consulting and technology services company seeking an experienced Azure Databricks engineer to join our team.As an Azure Databricks engineer, you will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks. You will also develop data processing...
-
Databricks Azure Cloud ML Engineering Manager
3 weeks ago
Pune, Maharashtra, India ACL Digital Full timeAbout the RoleWe are looking for a highly skilled Machine Learning Engineer to lead our team in training and retraining existing ML models using Databricks on the Azure cloud platform.The ideal candidate will have experience working with Databricks, automating training workflows, and handling data from Google BigQuery. In this role, you will be responsible...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India Tata Consultancy Services Full timeWelcome to this exciting opportunity at Tata Consultancy Services! As a seasoned Data Engineer, you will play a pivotal role in shaping our client's data strategy using cutting-edge technologies.Job Title: Data Engineer - Azure Databricks ExpertEstimated Salary: ₹1,200,000 - ₹2,400,000 per annumLocation: Bangalore and PuneWe are looking for an...
-
Databricks Solutions Architect
13 hours ago
Pune, Maharashtra, India Hoonar Tekwurks Private Limited Full timeJob Title: Databricks Solutions ArchitectWe are seeking an experienced Databricks Solutions Architect to join our team at Hoonar Tekwurks Private Limited. The ideal candidate will have a strong background in designing and implementing data solutions using Azure Databricks and a minimum of 5 years of experience working with data platforms on Azure.Our...
-
Pune, Maharashtra, India ACL Digital Full timeACL Digital is seeking a highly skilled Data Science Engineer to lead the development of machine learning models on Azure Databricks. With a strong background in data engineering and machine learning, this individual will design, implement, and maintain large-scale data pipelines using Databricks on Azure.About the Role:We are looking for an experienced...
-
Senior Databricks Developer Lead
3 weeks ago
Pune, Maharashtra, India Genpact Full timeUnlock Data-Driven Insights with Our Senior Databricks Developer Lead RoleWe are seeking an experienced Senior Databricks Developer Lead to join our team at Genpact, a global professional services and solutions firm. As a key member of our data engineering team, you will be responsible for solving real-world cutting-edge problems and driving business value...
-
Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full timeJob Overview:N-Systems Technologies Pvt Ltd is seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines using Azure Databricks.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annumKey Responsibilities:Design, develop, and optimize...
-
Databricks Engineer
2 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeAt LTIMindtree, we are seeking a highly skilled Databricks engineer to join our team. As a Databricks engineer, you will play a key role in designing and implementing high-quality data management systems using Azure Databricks.The ideal candidate will have experience with Python and Time Series processing, as well as knowledge of Spark SQL and other...
-
Azure Data Engineering Lead
12 hours ago
Pune, Maharashtra, India Foundit Full time**About Foundit**Foundit is a leading organization in the field of data engineering, and we're seeking an experienced Azure Data Engineering Lead to join our team.**Job Summary**We're looking for a highly skilled professional with expertise in Azure development and data solutions. The ideal candidate will have a strong background in cloud data technologies,...
-
Azure Technical Lead
13 hours ago
Pune, Maharashtra, India InterSources Inc Full timeAbout the OpportunityWe are looking for an experienced Azure Technical Lead to join our team at InterSources Inc. As an Azure Technical Lead, you will be responsible for leading the implementation of Azure-based solutions for our clients.Key ResponsibilitiesDesign and implement scalable and secure cloud architectures on the Azure platform.Develop and...
-
Big Data Engineer
1 week ago
Pune, Maharashtra, India LTIMindtree Full timeJob SummaryWe are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.About the RoleAs a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India Tata Consultancy Services Full timeJob SummaryWe are seeking a highly skilled Data Engineer - Databricks Solutions Architect to join our team at Tata Consultancy Services.About the RoleThe successful candidate will be responsible for designing and implementing scalable data solutions using Azure Data Engineering services, including Databricks. You will work closely with cross-functional teams...
-
Databricks Engineer
3 weeks ago
Pune, Maharashtra, India LTIMindtree Full timeLTIMindtree is a global technology consulting and services company.We are seeking a highly skilled Databricks Engineer with expertise in Python and Time Series processing.The ideal candidate will design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks.The salary for this position is estimated to be around...
-
Pune, Maharashtra, India N-Systems Technologies Pvt Ltd Full timeJob OverviewN-Systems Technologies Pvt Ltd is seeking an experienced Azure Databricks Engineer to join our team. The successful candidate will have a minimum of 5 years of experience in designing, developing, and maintaining data pipelines and data streams using Azure Databricks and Python.About the RoleWe are looking for a skilled professional who can...
-
Senior Data Engineer
1 month ago
Pune, Maharashtra, India Genpact Full timeAs a seasoned professional at Genpact, we invite applications for a highly skilled Senior Data Engineer - DataBricks Expert to join our team. This role plays a pivotal part in designing, building, and maintaining scalable and reliable data pipelines using DataBricks, ensuring seamless integration with cross-functional teams. Key Responsibilities: ...
-
Azure Data Engineering Leader
4 weeks ago
Pune, Maharashtra, India MICHELIN Full timeWe are seeking an exceptional Azure Data Engineering Leader to join our team at MICHELIN.About the RoleThis is a challenging and rewarding opportunity for an experienced professional with expertise in Azure data engineering, technical leadership, and stakeholder management.Job DescriptionThe successful candidate will lead the design, development, and...
-
Cloud Solutions Architect
2 weeks ago
Pune, Maharashtra, India Birlasoft Full timeAbout BirlasoftBirlasoft is a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation.As part of the CK Birla Group, a...
-
Azure Data Architecture Specialist
1 day ago
Pune, Maharashtra, India DFCS Technologies Full time**Job Title:** Azure Data Architecture Specialist**Location:** [Location: Assuming based on the job title and company]**Salary:** $180,000 - $220,000 per yearDFCS Technologies is seeking an experienced Azure Data Architecture Specialist to design, develop, and manage scalable, reliable, and secure data pipelines on the Microsoft Azure platform. As a key...