Senior Azure Databricks Engineer

4 weeks ago

Coimbatore, Tamil Nadu, India Quant-data Full time

We're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time)

Join us to build scalable, cloud-native data solutions using cutting-edge technologies

We're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space, especially those skilled in Python, Spark, SQL, Azure (ADLS, ADF), Databricks, and ETL development. You'll design and develop robust data pipelines that drive analytics and data science solutions across the organization.

Role: Senior Data Engineer

Mandatory Skills: Python, Spark, SQL, ADLS, Databricks, ADF, ETL

Work Type: Full-Time or Part-Time (Remote / Work from Home)

Key Responsibilities:

  • Design and implement scalable data pipelines using Azure Data Factory (ADF) and Databricks, following best practices.
  • Perform ETL processes across large datasets, ensuring high data quality and integrity.
  • Use Python and Spark to build complex transformations and aggregations.
  • Integrate data pipelines with APIs and external systems.
  • Monitor and troubleshoot pipelines to ensure smooth operation.
  • Collaborate with data scientists, analysts, and other engineering teams to deliver insights.
  • Act as a solution architect on Azure-based cloud data projects.
  • Demonstrate expert-level knowledge in Spark, with solid experience in SQL, Python, Java, or Scala.
  • Contribute to the architecture and operationalization of data lakes, warehouses, and analytics platforms across cloud and on-prem.
  • Communicate complex solutions clearly across stakeholders.
  • (Bonus: Experience in Insurance domain is a plus.)

Data Quality & Catalog Focus:

  • Ensure accuracy and completeness of data through profiling and validation.
  • Apply data quality frameworks and adhere to governance standards.
  • Work with cataloging tools to maintain clear metadata and documentation.
  • Foster collaboration to support reliable and trusted data assets.
  • Whether you're looking for a full-time opportunity or part-time flexibility, this role offers a chance to work with modern tools in a high-impact environment.

  • Azure Databricks Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India Proso Full time

    Proso AI is Hiring – Azure Databricks Engineer (Contract Role) We are looking for an experienced Azure Databricks Engineer for a short-term role (3–4 months). Experience Required: 7+ years Key Skills & Responsibilities:Create/modify Azure Data Factory pipelinesDevelop and optimize Databricks notebooks using SQL & PythonWork with file formats: Parquet,...

  • Azure Data Engineer

    1 week ago

    Coimbatore, Tamil Nadu, India MindBrain Full time

    Job Title: Senior Azure Data Engineer – Remote Contract Location: Remote Contract Type: Full-time Contract Experience Required: 7+ Years (including healthcare domain experience) Duration: (Specify Contract Duration – 6 months Start Date: Immediate About the Role We are seeking an experienced Azure Data Engineer with a proven track record...

  • Databricks Engineering Professional

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a seasoned Databricks Administrator to join our team. As a key member of our data engineering department, you will be responsible for designing, deploying, and managing large-scale Databricks clusters.Responsibilities include:Designing and implementing high-performance Databricks cluster architectures;Deploying and configuring...

  • Azure Data Specialist

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityOur company is seeking a skilled Data Engineer to design, build and maintain a data architecture in Azure Databricks. The ideal candidate will have experience with Azure Databricks, Azure Data Factory, PySpark, Spark-SQL and ADLS.Responsibilities:Design and implement data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and...

  • Highly Skilled Cloud Data Engineer Wanted

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have expertise in designing and developing scalable data pipelines using Azure Data Factory (ADF) and Databricks.The successful candidate will be responsible for performing ETL processes across large datasets, ensuring high data quality and...

  • Reliable Infrastructure Specialist

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeDevops Full time ₹ 17,00,000 - ₹ 23,10,000

    Job OpportunityWe are seeking a highly skilled Senior Site Reliability Engineer to drive the success of our cloud-based infrastructure.This role requires a strong understanding of Linux/Windows operating systems and networking concepts, as well as experience with cloud technologies such as Azure.The ideal candidate will have hands-on experience with Docker,...

  • Senior Cloud Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeDataArchitect Full time ₹ 12,00,000 - ₹ 15,00,000

    Job OpportunityWe are looking for a skilled Data Architect to join our team and contribute to the development of our data solutions.As a Data Architect, you will play a key role in designing and implementing end-to-end data solutions that enable effective data processing and seamless analysis. You will work closely with our data science team to develop...

  • Sr Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India Aezion, Inc Full time

    Job Title: Sr/Lead Data EngineerLocation: Bangalore, Coimbatore.Experience Looking for : min 8+ YearsJob Type: Full-time (Work from office 5 days a week)This is more focused on Customer facing with Delivering the Solutions with Key Data Engineering Skills.Key Responsibilities:Delivery & Customer Focus:Serve as the primary point of contact for customers,...

  • Data Pipeline Architect

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    **Job Overview:**We are seeking a seasoned Databricks Professional to join our organization on a contract basis. The ideal candidate will possess a strong background in designing and implementing data pipelines using Azure Data Factory, developing high-performance Databricks notebooks leveraging SQL and Python, and working with various file formats.**Key...

  • Data Engineer

    4 weeks ago

    Coimbatore, Tamil Nadu, India Hash Agile Technologies Full time

    Role: Data Engineer Location: Coimbatore | Hyderabad | Remote Databricks environment using PySpark 1. 5~8 years as hands on Data Engineers. 2. Good Data Analysis skills is a must. 3. Hands on experience in designing, developing, and maintaining scalable data pipelines. 4. Implementing ETL processes, and ensuring data quality and performance within the...