Senior Azure Databricks Engineer
1 week ago
Job Title:
Azure Databricks Engineer
Location:
PAN India
Experience:
8–10 years total, with 4+ years relevant experience
Job Summary
We are looking for a highly skilled Azure Databricks Engineer to join our data engineering team. The ideal candidate will have hands-on expertise in building scalable data pipelines, optimizing big data workloads, and leveraging Azure cloud services to deliver high-performance analytics solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
- Collaborate with data scientists, analysts, and business stakeholders to deliver robust data solutions.
- Optimize Spark jobs for performance and cost-efficiency in cloud environments.
- Integrate data from Azure Data Lake, Azure SQL, Blob Storage, and external APIs.
- Implement data quality checks, monitoring, and alerting mechanisms.
- Work with Delta Lake for ACID-compliant storage and efficient data versioning.
- Automate workflows using Azure Data Factory, Airflow, or similar orchestration tools.
- Ensure security, governance, and compliance across data platforms.
- Mentor junior engineers and contribute to best practices and standards.
Primary Skills (Non-Negotiable)
- Python & PySpark
- Azure Databricks
- Azure Data Lake
- Azure Data Factory
- SQL
Other Required Skills
- Strong knowledge of Delta Lake, Parquet, and other big data formats.
- Experience with CI/CD pipelines and DevOps practices in data engineering.
- Familiarity with Git, Terraform, or ARM templates for infrastructure automation.
- Excellent problem-solving and communication skills.
-
Senior azure databricks engineer
4 weeks ago
Mumbai, India MLAI Digital Private Ltd. Full timeCompany DescriptionMLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) , Singapore (PTE), Malaysia , India and Australia(MEL)Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...
-
Staff Technical Instructor
5 days ago
Mumbai Metropolitan Region, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per yearCSQ426R319The Staff Technical Trainer at Databricks will be a member of the Learning and Enablement organization. This role is integral to enhancing the technical skills and knowledge of the Databricks community, which includes internal teams, partners, and customers. The Staff Technical Trainer will primarily be responsible for the delivery of technical...
-
Azure Databricks
2 weeks ago
Mumbai, India Teamware Solutions Full timeJob Description Key Responsibilities: - Data Pipeline Development: Design, build, and maintain scalable ETL (Extract, Transform, Load) data pipelines using Azure Databricks, Apache Spark, and Python. - Spark Optimization: Develop and optimize Spark jobs for large-scale data processing on Databricks. Ensure that the jobs run efficiently, leveraging the...
-
Senior Data Engineer
24 hours ago
Mumbai Metropolitan Region, India Albatronix Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer to join an on-site engineering team in Goregaon, Mumbai. This role is ideal for hands-on engineers who design, build, and operate scalable, production-grade data pipelines and analytical platforms that serve machine learning, BI, and real-time streaming use cases.Role & ResponsibilitiesDesign and implement tailored data...
-
Mumbai, India Natobotics Technologies Pvt Limited Full timeDescription : Senior Data Engineer - Azure ETL/ELT & : Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, : 6-8 YearsAbout the Role :We are seeking an experienced Senior Data Engineer with 6-8 years in data engineering to join our team across multiple locations. This role is focused on designing, developing, and maintaining scalable and...
-
Senior azure engineer
4 weeks ago
Mumbai, India MLAI Digital Private Ltd. Full timeMLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions. FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial Transactions This is a full-time on-site role for a Senior Databricks Engineer located in Mumbai. As a Data Engineer, you will work...
-
Azure Architect
1 day ago
Mumbai Metropolitan Region, India HMH Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout UsHMH is a leading provider of drilling solutions, offering a wide range of products and services that are designed to be the safest and most efficient in the industry. Apart from our expertise in land and offshore operations, we are continuously expanding our knowledge within subsea mining, geothermal, onshore and offshore construction, as well as...
-
Azure Databricks Engineer
3 weeks ago
Chennai, Mumbai, India Capgemini Full timeJob Description Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of...
-
Mumbai, India Quantiphi Analytics Full timeWhile technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life,...
-
Microsoft Azure, Databricks
1 week ago
Mumbai, Maharashtra, India Natobotics Full time ₹ 20,00,000 - ₹ 25,00,000 per yearHi ConnectionsWe are Hiringhashtag#MicrosoftAzure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory # Immediate Joiners Job Title: Developer Work Location: Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA Skill Required: Digital: Microsoft Azure, Digital: Python for Data Science, Digital:...