Senior Data Engineer – Databricks

3 days ago

Hyderabad, Telangana, India Anblicks Full time

Job Title: Senior Data Engineer – Databricks

Location: Hyderabad / Ahmedabad

Experience: 6+ Years

About the Role

We are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the design and development of modern data pipelines, drive enterprise data transformation initiatives, and contribute to a future-ready data architecture that blends best practices across Databricks, Azure, and Fabric.

This is a strategic role for a data expert who enjoys solving high-impact business problems through modern data platforms, scalable pipelines, and cloud-native tools.

Key Responsibilities

Data Engineering & Architecture

  • Design and implement scalable, high-performance data pipelines on Databricks using PySpark, SQL, and Delta Lake.
  • Develop and optimize data lakehouse architectures, ensuring robust data ingestion, transformation, and storage.
  • Build and manage ETL/ELT workflows integrating structured and semi-structured data from diverse sources.
  • Apply best practices in data modeling, partitioning, and performance tuning.

Cloud & Platform Integration

  • Leverage Databricks on Azure for large-scale distributed processing, including job orchestration and notebook management.
  • Collaborate with platform teams to enable secure, scalable, and governed data environments across cloud ecosystems.

Solutioning & Collaboration

  • Partner with business analysts, architects, and client stakeholders to translate business needs into scalable data solutions.
  • Ensure data quality, lineage, and observability through tools like Unity Catalog, Great Expectations, or Azure Purview.
  • Guide and mentor junior engineers, enforce code and design standards, and drive adoption of reusability and best practices.
  • Document technical designs, data flow diagrams, and data governance procedures.

Required Skills & Experience

  • 6+ years of experience in Data Engineering, with focus on data warehousing, distributed processing, and cloud platforms.
  • 3+ years of hands-on experience in Databricks: PySpark, Delta Lake, MLflow (optional).
  • Proficient in SQL, data modeling, and performance tuning for analytical workloads.
  • Experience building scalable pipelines on Azure (ADF, Synapse, or Azure Functions).
  • Understanding of data governance principles, RBAC, and metadata management.

Preferred / Bonus Skills

  • Knowledge of Medallion architecture, CDC patterns, or event-driven data processing.
  • Familiarity with Unity Catalog, Azure Purview, Databricks SQL, and data observability tools.
  • Certification: Databricks Certified Data Engineer Associate/Professional, Microsoft Azure Data Engineer.

Why Join Us

  • Be part of an innovation-driven team modernizing enterprise data ecosystems.
  • Lead high-impact data initiatives with global customers across industries.
  • Work with cutting-edge technologies like Databricks, Microsoft Fabric, and modern Azure stack.
  • Accelerate your career in a cloud-native, AI-ready data engineering environment.

  • Senior Data Engineer – Databricks

    3 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – Databricks Location: Hyderabad / Ahmedabad Experience: 6+ Years About the Role We are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks.Exposure to Data Modelling is a strong plus.In this role, you will lead the...

  • Senior Data Engineer – Databricks

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – Databricks Location: Hyderabad / Ahmedabad Experience: 6+ Years About the Role We are looking for a Senior Data Engineer with a strong foundation in data warehousing , cloud-native data engineering , and deep hands-on experience with Databricks . Exposure to Data Modelling is a strong plus. In this role, you will...

  • Senior Data Engineer – Databricks

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – Databricks Location: Hyderabad / Ahmedabad Experience: 6+ Years About the Role We are looking for a Senior Data Engineer with a strong foundation in data warehousing , cloud-native data engineering , and deep hands-on experience with Databricks . Exposure to Data Modelling is a strong plus. In this role, you will...

  • Senior Data Engineer – Databricks

    1 day ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – DatabricksLocation: Hyderabad / AhmedabadExperience: 6+ YearsAbout the RoleWe are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the design...

  • Lead Data Engineer – Databricks

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Lead Data Engineer – Databricks & Microsoft Fabric Location: Hyderabad / Ahmedabad Experience: 8+ Years About the Role We are looking for a Lead Data Engineer with a strong foundation in data warehousing , cloud-native data engineering , and deep hands-on experience with Databricks . Exposure to Microsoft Fabric is a strong plus. In this...

  • Senior Databricks Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India DataNimbus Full time

    About DataNimbus At DataNimbus, we are on a mission to redefine how organizations leverage Data and AI to drive growth, innovation, and efficiency. Our pioneering products, such as DataNimbus Designer (a cloud-native ETL designer), datanimbus.io (a comprehensive data and integration platform), FinHub.ai (payment modernization platform) empower...

  • Senior Databricks Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India DataNimbus Full time

    About Data Nimbus At Data Nimbus, we are on a mission to redefine how organizations leverage Data and AI to drive growth, innovation, and efficiency.Our pioneering products, such as Data Nimbus Designer (a cloud-native ETL designer), datanimbus.io (a comprehensive data and integration platform), Fin Hub.ai (payment modernization platform) empower businesses...

  • Lead Data Engineer

    2 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Data Engineer - Databricks SpecialistJob Summary:We are seeking a seasoned data engineering expert with expertise in Databricks, PySpark, and SQL to spearhead our data engineering initiatives.Main Responsibilities:Design and develop end-to-end data pipelines using Azure Data Factory for seamless data ingestion and transformation.Collaborate closely with...

  • Databricks Engineer

    3 weeks ago

    Hyderabad, Telangana, India Optimum Solutions Pte Ltd Full time

    Databricks EngineerExperience : 5+ Years of experienceLocation: Chennai & PuneRequired skills & Experience• 5–8 years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.• Handson expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture),...

  • Databricks Developer

    4 days ago

    Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...