Azure Databricks Engineer

3 days ago

Bangalore Rural Bengaluru, India BLJ Tech Geeks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Job Description: Azure Databricks Engineer

Position: Azure Databricks Engineer

Location: [Specify Location / Remote / Hybrid]

Experience Required: 4 10 years (depending on role level)

Role Overview

We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions on Azure. The ideal candidate will have strong expertise in building scalable big data solutions using Databricks, Spark, and Azure cloud services, with a focus on delivering reliable, secure, and high-performing data platforms.

Key Responsibilities

  • Design, build, and optimize scalable ETL/ELT pipelines on Azure Databricks.
  • Work with structured, semi-structured, and unstructured data from diverse sources.
  • Implement Delta Lake, Unity Catalog, and Lakehouse architecture for data governance and performance optimization.
  • Collaborate with data architects, analysts, and business teams to translate business needs into technical solutions.
  • Integrate Databricks with other Azure services such as Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure Data Factory (ADF), Azure Event Hub, and Azure Functions.
  • Implement data quality frameworks, monitoring, and logging for pipelines.
  • Tune and optimize Spark jobs, cluster configurations, and costs.
  • Ensure security, compliance, and best practices in cloud-based data processing.
  • Participate in CI/CD implementation for data pipelines using Azure DevOps/GitHub Actions.
  • Support and troubleshoot production workloads with high availability and reliability.

Required Skills & Qualifications

  • Strong experience in Azure Databricks and Apache Spark (PySpark/Scala/SQL).
  • Hands-on expertise with Azure Data Lake Storage, ADF, Synapse, Event Hub, Service Bus.
  • Experience with Delta Lake, Unity Catalog, and Lakehouse implementations.
  • Solid understanding of data modeling, partitioning, and performance optimization.
  • Proficiency in SQL and at least one programming language (Python/Scala/Java).
  • Knowledge of CI/CD pipelines, Git, and DevOps practices.
  • Familiarity with data governance, security, and compliance frameworks.
  • Strong problem-solving and analytical skills with ability to handle large-scale datasets.

Preferred Qualifications

  • Azure certifications (e.g., DP-203: Data Engineer Associate, AZ-305, or equivalent).
  • Experience with streaming data pipelines using Spark Structured Streaming, Kafka, or Event Hub.
  • Knowledge of machine learning pipelines using MLflow or Azure Machine Learning.

  • Azure Databricks

    6 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure Databricks**: **Job Description: Data Engineer (Azure Databricks & PySpark)**: **Position**: Data Engineer **Experience**: 3 to 5 years **Primary Skills**: Azure Databricks, PySpark, SQL **Secondary Skills**: ADF (Azure Data Factory) **Location**: Bengaluru/Hyderabad **Mode of Work**: Hybrid **Notice Period**: 0 to 30 Days **Key...

  • azure databricks

    1 week ago

    Bengaluru, Karnataka, India Response Informatics Full time

    Alteryx, Databricks and Azure Data Engineering. Secondary skill: Python

  • azure databricks

    6 days ago

    Bengaluru, Karnataka, India Response Informatics Full time

    Alteryx, Databricks and Azure Data Engineering. Secondary skill: Python

  • Azure Databricks Administrator

    3 days ago

    Bengaluru, Karnataka, India Pylon Management Consulting Full time US$ 90,000 - US$ 1,20,000 per year

    Job Summary :We are seeking a highly experienced and skilled Azure Databricks Administrator to join our team. The ideal candidate will have a deep understanding of Azure Databricks, cloud infrastructure, and data engineering principles. You will be responsible for the design, deployment, and management of our Azure Databricks environment, ensuring its...

  • Azure Databrick

    1 week ago

    Bengaluru, India Ushankk Full time

    **Azure Databrick** *** **Location**: Bangalore **Industry**: Information Technology **Skill**: Datalake **Experience**: 5 - 9 years Azure Databrick / Datalake - Strong knowledge of Data Management principles Designing and implementing data ingestion pipelines using Spark. - Direct experience of building data pipelines using Azure Data Factory and...

  • Azure Databricks Engineer

    3 days ago

    Bengaluru, Chennai, Hyderabad, India Tekskills Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Role: Azure Databricks EngineerJob Location: New Delhi / Hyderabad, TS / Gurgaon, HR / Chennai, TN / Bangalore, KA / Noida, UPWork Mode: (Hybrid/WFO)Skills Required: Azure DatabricksExperience: 6-8 Years(Rel 5+ Yrs)Job Description:Design and develop reusable software modules that meet customer requirements while upholding high standards of reliability,...

  • AZURE DATABRICKS

    18 minutes ago

    Bengaluru, Karnataka, India Contactx Resource Management Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    AZURE DATABRICKS (7-17 YEARS), IMMEDIATE TO 60 DAYS JOINER, BANGALORE LOCATIONHiring for 1 of BIG4,Immediate to 60 days Joiner,Data Bricks AM Level (7-10 Years)Data Bricks Manager Level Years)D esigning and developing scalable data pipelines and ETL processes using Azure Databricks and PySpark , optimizing data workflows, ensuring data quality, collaborating...

  • - Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Skan ai Full time

    Job Summary :We are seeking a skilled Data Engineer with 3 to 5 years of experience in building scalable data pipelines and solutions, with strong hands-on expertise in Databricks. The ideal candidate should be proficient in working with large-scale data processing frameworks and have a solid understanding of Delta Lake, PySpark, and cloud-based data...

  • Azure Databricks

    3 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS invites applicants for Walk in: JD: Role - Azure/ AWS Data Engineer Location - Mumbai, Bangalore, Chennai, Hyderabad, Pune - Proficient in Python and PySpark. - Strong knowledge of SQL. - Experience in building and optimizing complex data pipelines in Azure. - Hands on experience on Azure Databricks. - Strong working knowledge on Azure components and...

  • Azure Databricks

    1 week ago

    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Client Our client is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies Powered by more than 84 000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients With its extensive domain and technology...