Senior Data Engineer – Databricks

4 weeks ago

Hyderabad, Telangana, India Anblicks Full time

Job Title: Senior Data Engineer – Databricks

Location: Hyderabad / Ahmedabad

Experience: 6+ Years

About the Role

We are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the design and development of modern data pipelines, drive enterprise data transformation initiatives, and contribute to a future-ready data architecture that blends best practices across Databricks, Azure, and Fabric.

This is a strategic role for a data expert who enjoys solving high-impact business problems through modern data platforms, scalable pipelines, and cloud-native tools.

Key Responsibilities

Data Engineering & Architecture

  • Design and implement scalable, high-performance data pipelines on Databricks using PySpark, SQL, and Delta Lake.
  • Develop and optimize data lakehouse architectures, ensuring robust data ingestion, transformation, and storage.
  • Build and manage ETL/ELT workflows integrating structured and semi-structured data from diverse sources.
  • Apply best practices in data modeling, partitioning, and performance tuning.

Cloud & Platform Integration

  • Leverage Databricks on Azure for large-scale distributed processing, including job orchestration and notebook management.
  • Collaborate with platform teams to enable secure, scalable, and governed data environments across cloud ecosystems.

Solutioning & Collaboration

  • Partner with business analysts, architects, and client stakeholders to translate business needs into scalable data solutions.
  • Ensure data quality, lineage, and observability through tools like Unity Catalog, Great Expectations, or Azure Purview.
  • Guide and mentor junior engineers, enforce code and design standards, and drive adoption of reusability and best practices.
  • Document technical designs, data flow diagrams, and data governance procedures.

Required Skills & Experience

  • 6+ years of experience in Data Engineering, with focus on data warehousing, distributed processing, and cloud platforms.
  • 3+ years of hands-on experience in Databricks: PySpark, Delta Lake, MLflow (optional).
  • Proficient in SQL, data modeling, and performance tuning for analytical workloads.
  • Experience building scalable pipelines on Azure (ADF, Synapse, or Azure Functions).
  • Understanding of data governance principles, RBAC, and metadata management.

Preferred / Bonus Skills

  • Knowledge of Medallion architecture, CDC patterns, or event-driven data processing.
  • Familiarity with Unity Catalog, Azure Purview, Databricks SQL, and data observability tools.
  • Certification: Databricks Certified Data Engineer Associate/Professional, Microsoft Azure Data Engineer.

Why Join Us

  • Be part of an innovation-driven team modernizing enterprise data ecosystems.
  • Lead high-impact data initiatives with global customers across industries.
  • Work with cutting-edge technologies like Databricks, Microsoft Fabric, and modern Azure stack.
  • Accelerate your career in a cloud-native, AI-ready data engineering environment.

  • Senior Data Engineer – Databricks

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – DatabricksLocation: Hyderabad / AhmedabadExperience: 6+ YearsAbout the RoleWe are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the design...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    24 hours ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Azure Databricks Engineer

    2 days ago

    Hyderabad, Telangana, India Innovatz Global Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionInnovatz is a global management consulting, technology services, and business process outsourcing company headquartered in Kuala Lumpur, Malaysia. We have a significant presence in America, China, India, Australia, Korea, Hong Kong, Singapore, Thailand, Philippines, Indonesia, and Vietnam. Our skilled workforce of over 500 professionals...

  • Databricks Engineer

    2 days ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Databricks Data Engineer

    6 days ago

    Hyderabad, Telangana, India Rubis software solutions Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Position OverviewWe are seeking an experienced Data Engineer with strong expertise in Databricks, Azure Data Services ecosystem (ADF, ADLS, Microsoft Fabric, Synapse, etc.), Python, PySpark, and databases. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions to enable advanced analytics,...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)- Translate business rules into technical specifications and implement scalable data solutions.- Manage...

  • Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India Stanra Tech Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects...

  • Databricks Developer

    1 week ago

    Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...

  • Senior Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India iO Associates - UKEU Full time

    Senior Data EngineerRemoteiO Associates is looking for a Senior Data Engineer for one of our leading clients to join the Innovation Technology team. In this role, you'll be a key player in designing and maintaining data pipelines on Azure using Databricks, ADF, and PySpark. They ensure data is secure, reliable, and optimised for analytics, while mentoring...