Azure Databricks Engineer

2 days ago

Bangalore Rural Bengaluru, India BLJ Tech Geeks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Description: Azure Databricks Engineer

Position: Azure Databricks Engineer

Location: [Specify Location / Remote / Hybrid]

Experience Required: 4 10 years (depending on role level)

Role Overview

We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions on Azure. The ideal candidate will have strong expertise in building scalable big data solutions using Databricks, Spark, and Azure cloud services, with a focus on delivering reliable, secure, and high-performing data platforms.

Key Responsibilities

  • Design, build, and optimize scalable ETL/ELT pipelines on Azure Databricks.
  • Work with structured, semi-structured, and unstructured data from diverse sources.
  • Implement Delta Lake, Unity Catalog, and Lakehouse architecture for data governance and performance optimization.
  • Collaborate with data architects, analysts, and business teams to translate business needs into technical solutions.
  • Integrate Databricks with other Azure services such as Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure Data Factory (ADF), Azure Event Hub, and Azure Functions.
  • Implement data quality frameworks, monitoring, and logging for pipelines.
  • Tune and optimize Spark jobs, cluster configurations, and costs.
  • Ensure security, compliance, and best practices in cloud-based data processing.
  • Participate in CI/CD implementation for data pipelines using Azure DevOps/GitHub Actions.
  • Support and troubleshoot production workloads with high availability and reliability.

Required Skills & Qualifications

  • Strong experience in Azure Databricks and Apache Spark (PySpark/Scala/SQL).
  • Hands-on expertise with Azure Data Lake Storage, ADF, Synapse, Event Hub, Service Bus.
  • Experience with Delta Lake, Unity Catalog, and Lakehouse implementations.
  • Solid understanding of data modeling, partitioning, and performance optimization.
  • Proficiency in SQL and at least one programming language (Python/Scala/Java).
  • Knowledge of CI/CD pipelines, Git, and DevOps practices.
  • Familiarity with data governance, security, and compliance frameworks.
  • Strong problem-solving and analytical skills with ability to handle large-scale datasets.

Preferred Qualifications

  • Azure certifications (e.g., DP-203: Data Engineer Associate, AZ-305, or equivalent).
  • Experience with streaming data pipelines using Spark Structured Streaming, Kafka, or Event Hub.
  • Knowledge of machine learning pipelines using MLflow or Azure Machine Learning.

  • Data engineer | azure + databricks

    7 days ago

    Bangalore, India Xebia Full time

    ???? Job Opportunity – Data Engineer | Azure + Databricks ???? Location: Bangalore (Whitefield) | Hybrid (3 days office/week) Experience: 6+ years Notice Period: Immediate to 2 weeks – only apply if you can join early About the Role: We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data...

  • Data Engineer | Azure + Databricks

    3 days ago

    Bangalore, India Xebia Full time

    Job Opportunity – Data Engineer | Azure + Databricks Bangalore (Whitefield) | Hybrid (3 days office/week) Experience: 6+ years Immediate to 2 weeks – only apply if you can join early We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases . The ideal candidate will have...

  • Azure databricks, PySpark

    1 week ago

    bangalore, India Tata Consultancy Services Full time

    Role: Azure Data Engineer(ADF, ADB)Required Technical Skill Set: Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLExp : 4 to 6 YearLocation : Kolkata, Pune, Mumbai, Bangalore, BhubaneshwarMust-Have · Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse; establishing the cloud connectivity between...

  • Data Engineer | Azure + Databricks

    1 week ago

    Bangalore, India Xebia Full time

    Job Opportunity – Data Engineer | Azure + Databricks Location: Bangalore (Whitefield) | Hybrid (3 days office/week) Experience: 6+ years Notice Period: Immediate to 2 weeks – only apply if you can join early About the Role: We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and...

  • Azure Data Engineer

    2 weeks ago

    bangalore, India iO Associates Full time

    Azure Data Engineer - Databricks ExpertREMOTEFull-timeShift Timings: 2 pm - 11 pm IST Our client is a leading AI-driven tech company transforming global enterprises with innovative solutions in data intelligence, automation, and responsible AI. With a mission to help enterprises modernize and scale, they focus on delivering intelligent, future-ready...

  • Data Engineering Azure databricks

    13 hours ago

    bangalore, India EXL Full time

    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Responsibilities: Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes. Create the data integration and data diagram...

  • Data Engineering Azure databricks

    2 days ago

    bangalore, India EXL Full time

    Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead...

  • Data Engineer | Azure + Databricks

    1 week ago

    bangalore, India Xebia Full time

    🔹 Job Opportunity – Data Engineer | Azure + Databricks 🔹Location: Bangalore (Whitefield) | Hybrid (3 days office/week)Experience: 6+ yearsNotice Period: Immediate to 2 weeks – only apply if you can join earlyAbout the Role:We are looking for a skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases....

  • Azure Databricks Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...