Senior Data Engineer – Databricks

3 weeks ago

Hyderabad, Telangana, India Anblicks Full time

Job Title: Senior Data Engineer – Databricks

Location: Hyderabad / Ahmedabad

Experience: 6+ Years

About the Role

We are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the design and development of modern data pipelines, drive enterprise data transformation initiatives, and contribute to a future-ready data architecture that blends best practices across Databricks, Azure, and Fabric.

This is a strategic role for a data expert who enjoys solving high-impact business problems through modern data platforms, scalable pipelines, and cloud-native tools.

Key Responsibilities

Data Engineering & Architecture

  • Design and implement scalable, high-performance data pipelines on Databricks using PySpark, SQL, and Delta Lake.
  • Develop and optimize data lakehouse architectures, ensuring robust data ingestion, transformation, and storage.
  • Build and manage ETL/ELT workflows integrating structured and semi-structured data from diverse sources.
  • Apply best practices in data modeling, partitioning, and performance tuning.

Cloud & Platform Integration

  • Leverage Databricks on Azure for large-scale distributed processing, including job orchestration and notebook management.
  • Collaborate with platform teams to enable secure, scalable, and governed data environments across cloud ecosystems.

Solutioning & Collaboration

  • Partner with business analysts, architects, and client stakeholders to translate business needs into scalable data solutions.
  • Ensure data quality, lineage, and observability through tools like Unity Catalog, Great Expectations, or Azure Purview.
  • Guide and mentor junior engineers, enforce code and design standards, and drive adoption of reusability and best practices.
  • Document technical designs, data flow diagrams, and data governance procedures.

Required Skills & Experience

  • 6+ years of experience in Data Engineering, with focus on data warehousing, distributed processing, and cloud platforms.
  • 3+ years of hands-on experience in Databricks: PySpark, Delta Lake, MLflow (optional).
  • Proficient in SQL, data modeling, and performance tuning for analytical workloads.
  • Experience building scalable pipelines on Azure (ADF, Synapse, or Azure Functions).
  • Understanding of data governance principles, RBAC, and metadata management.

Preferred / Bonus Skills

  • Knowledge of Medallion architecture, CDC patterns, or event-driven data processing.
  • Familiarity with Unity Catalog, Azure Purview, Databricks SQL, and data observability tools.
  • Certification: Databricks Certified Data Engineer Associate/Professional, Microsoft Azure Data Engineer.

Why Join Us

  • Be part of an innovation-driven team modernizing enterprise data ecosystems.
  • Lead high-impact data initiatives with global customers across industries.
  • Work with cutting-edge technologies like Databricks, Microsoft Fabric, and modern Azure stack.
  • Accelerate your career in a cloud-native, AI-ready data engineering environment.

  • Senior Data Engineer – Databricks

    3 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – Databricks Location: Hyderabad / Ahmedabad Experience: 6+ Years About the Role We are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the...

  • Senior Data Engineer/Architect

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Databricks Data Engineer

    2 days ago

    Hyderabad, Telangana, India Rubis software solutions Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Position OverviewWe are seeking an experienced Data Engineer with strong expertise in Databricks, Azure Data Services ecosystem (ADF, ADLS, Microsoft Fabric, Synapse, etc.), Python, PySpark, and databases. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions to enable advanced analytics,...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...

  • Databricks Engineer

    4 days ago

    Hyderabad, Telangana, India Stanra Tech Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects...

  • Data Engineer – Databricks Platform

    2 weeks ago

    Hyderabad, Telangana, India Cropboy solutions Full time ₹ 14,00,000 - ₹ 18,00,000 per year

    Position OverviewWe are looking for an experienced Data Engineer to design and implement a scalable data platform using Databricks. The ideal candidate will have strong expertise in building modern data architectures, integrating diverse data sources (SQL Server, MongoDB, InfluxDB), and enabling analytics and reporting use cases.Key Responsibilities●...

  • Databricks Developer

    4 days ago

    Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...

  • Azure Databricks

    4 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 5+ yearsSenior Azure Data Engineer:Strong background in data engineering, experience with Azure data services, and the ability to transform raw data into valuable business insights. Proficiency in Azure data services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Azure Databricks. Strong knowledge of programming...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India iO Associates - UKEU Full time

    Senior Data EngineerRemoteiO Associates is looking for a Senior Data Engineer for one of our leading clients to join the Innovation Technology team. In this role, you'll be a key player in designing and maintaining data pipelines on Azure using Databricks, ADF, and PySpark. They ensure data is secure, reliable, and optimised for analytics, while mentoring...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India iO Associates - UKEU Full time

    Senior Data Engineer Remote iO Associates is looking for a Senior Data Engineer for one of our leading clients to join the Innovation Technology team. In this role, you'll be a key player in designing and maintaining data pipelines on Azure using Databricks, ADF, and PySpark. They ensure data is secure, reliable, and optimised for analytics, while...