Senior Azure Databricks Engineer

1 week ago

Mumbai Metropolitan Region, India SWITS DIGITAL Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Title:
Azure Databricks Engineer

Location:
PAN India

Experience:
8–10 years total, with 4+ years relevant experience

Job Summary
We are looking for a highly skilled Azure Databricks Engineer to join our data engineering team. The ideal candidate will have hands-on expertise in building scalable data pipelines, optimizing big data workloads, and leveraging Azure cloud services to deliver high-performance analytics solutions.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver robust data solutions.
  • Optimize Spark jobs for performance and cost-efficiency in cloud environments.
  • Integrate data from Azure Data Lake, Azure SQL, Blob Storage, and external APIs.
  • Implement data quality checks, monitoring, and alerting mechanisms.
  • Work with Delta Lake for ACID-compliant storage and efficient data versioning.
  • Automate workflows using Azure Data Factory, Airflow, or similar orchestration tools.
  • Ensure security, governance, and compliance across data platforms.
  • Mentor junior engineers and contribute to best practices and standards.

Primary Skills (Non-Negotiable)

  • Python & PySpark
  • Azure Databricks
  • Azure Data Lake
  • Azure Data Factory
  • SQL

Other Required Skills

  • Strong knowledge of Delta Lake, Parquet, and other big data formats.
  • Experience with CI/CD pipelines and DevOps practices in data engineering.
  • Familiarity with Git, Terraform, or ARM templates for infrastructure automation.
  • Excellent problem-solving and communication skills.

  • Senior azure databricks engineer

    1 week ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) , Singapore (PTE), Malaysia , India and Australia(MEL)Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Senior azure databricks engineer

    7 days ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) , Singapore (PTE), Malaysia , India and Australia(MEL)Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Senior azure databricks engineer

    2 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company Description MLAI_Digital is a Gen AI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions. Offices in US(ohio) , Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial Transactions Role...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL)Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Staff Technical Instructor

    5 days ago

    Mumbai Metropolitan Region, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    CSQ426R319The Staff Technical Trainer at Databricks will be a member of the Learning and Enablement organization. This role is integral to enhancing the technical skills and knowledge of the Databricks community, which includes internal teams, partners, and customers. The Staff Technical Trainer will primarily be responsible for the delivery of technical...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) 🇺🇸 ,Singapore 🇸🇬 (PTE), Malaysia , India 🇮🇳 and Australia(MEL) 🇦🇺Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) 🇺🇸 ,Singapore 🇸🇬 (PTE), Malaysia , India 🇮🇳 and Australia(MEL) 🇦🇺Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) 🇺🇸 ,Singapore 🇸🇬 (PTE), Malaysia , India 🇮🇳 and Australia(MEL) 🇦🇺Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for...

  • Senior Azure Databricks Engineer

    1 week ago

    Mumbai, Maharashtra, India, Maharashtra MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • [Urgent Search] Senior Azure Databricks Engineer

    2 weeks ago

    Mumbai, India MLAI Digital Private Ltd. Full time

    Company Description MLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions. Offices in US(ohio) 🇺🇸 ,Singapore 🇸🇬 (PTE), Malaysia , India 🇮🇳 and Australia(MEL) 🇦🇺 Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud...