Senior Azure Databricks Engineer

4 weeks ago

India Quant-data Full time

We're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time)

Join us to build scalable, cloud-native data solutions using cutting-edge technologies

We're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space, especially those skilled in Python, Spark, SQL, Azure (ADLS, ADF), Databricks, and ETL development. You'll design and develop robust data pipelines that drive analytics and data science solutions across the organization.

Role: Senior Data Engineer

Mandatory Skills: Python, Spark, SQL, ADLS, Databricks, ADF, ETL

Work Type: Full-Time or Part-Time (Remote / Work from Home)

Key Responsibilities:

  • Design and implement scalable data pipelines using Azure Data Factory (ADF) and Databricks, following best practices.
  • Perform ETL processes across large datasets, ensuring high data quality and integrity.
  • Use Python and Spark to build complex transformations and aggregations.
  • Integrate data pipelines with APIs and external systems.
  • Monitor and troubleshoot pipelines to ensure smooth operation.
  • Collaborate with data scientists, analysts, and other engineering teams to deliver insights.
  • Act as a solution architect on Azure-based cloud data projects.
  • Demonstrate expert-level knowledge in Spark, with solid experience in SQL, Python, Java, or Scala.
  • Contribute to the architecture and operationalization of data lakes, warehouses, and analytics platforms across cloud and on-prem.
  • Communicate complex solutions clearly across stakeholders.
  • (Bonus: Experience in Insurance domain is a plus.)

Data Quality & Catalog Focus:

  • Ensure accuracy and completeness of data through profiling and validation.
  • Apply data quality frameworks and adhere to governance standards.
  • Work with cataloging tools to maintain clear metadata and documentation.
  • Foster collaboration to support reliable and trusted data assets.
  • Whether you're looking for a full-time opportunity or part-time flexibility, this role offers a chance to work with modern tools in a high-impact environment.

  • Azure Databricks Engineer

    3 days ago

    India Proso Full time

    Proso AI is Hiring – Azure Databricks Engineer (Contract Role) We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities: Create/modify Azure Data Factory pipelines Develop and optimize Databricks notebooks using SQL & Python Work with file formats:...

  • Azure Databricks Engineer

    22 hours ago

    India Proso Full time

    Proso AI is Hiring – Azure Databricks Engineer (Contract Role)We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities:- Create/modify Azure Data Factory pipelines- Develop and optimize Databricks notebooks using SQL & Python- Work with file formats:...

  • Azure Databricks

    2 hours ago

    India Zensar Technologies Full time

    **Data Architect (Azure, ADF, Databricks) - 14+ Years Experience** **About the Role**: **Responsibilities**: - **Data Platform Architecture**: - Design and architect a comprehensive data platform on Azure, leveraging best practices for scalability, performance, security, and cost optimization. - Define the overall data architecture framework, including...

  • Azure Databricks Lead Engineer

    4 weeks ago

    India Alcor Solutions, Inc. Full time

    Alcor Solutions is a leading digital transformation and cloud consulting firm, enabling enterprises to leverage modern data platforms, cloud-native solutions, and emerging technologies to drive innovation and business outcomes.We are seeking an Azure Databricks Lead Engineer to architect, administer, and scale our enterprise Databricks environment while...

  • Senior Databricks SME

    3 weeks ago

    India DataE2E Technologies Full time

    Job Title: Senior Databricks EngineerLocation: 100% RemoteJob Type: Full-TimeAbout the Role:We are looking for an experienced Senior Databricks SME with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep...

  • Senior Databricks SME

    4 weeks ago

    India DataE2E Technologies Full time

    Job Title: Senior Databricks EngineerLocation: 100% Remote Job Type: Full-Time About the Role:We are looking for an experienced Senior Databricks SME with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep...

  • Senior Databricks SME

    3 weeks ago

    India DataE2E Technologies Full time

    Job Title: Databricks SMELocation: 100% RemoteJob Type: Full-TimeAbout the Role:We are looking for an experienced Senior Databricks SME with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of...

  • Senior Data Engineer Databricks

    2 weeks ago

    India Simbus Technologies Pvt. Ltd. Full time

    At Simbus, we bring Richard Branson's saying to life: "Train people well enough so they can leave, treat them well enough so they don't want to." JOB OVERVIEW: We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Databricks to join our dynamic team. The ideal candidate will have over 4 years of experience in...

  • Databricks Engineer

    3 weeks ago

    India DataE2E Technologies Full time

    Key Responsibilities- Design, develop, and maintain data pipelines and ETL processes on Databricks.- Lead the architecture and implementation of scalable, secure, and high-performance data solutions.- Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.- Optimize data workflows...

  • Databricks Engineer

    3 weeks ago

    India DataE2E Technologies Full time

    Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.Optimize data workflows for...