Databricks Developer

2 days ago


Hyderabad, Telangana, India Zetamicron Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job Title:
Databricks Developer

Location:
Bangalore, Chennai, Hyderabad, Pune

Experience:
5–7 Years

About the Role

We are seeking an experienced
Databricks Developer
with 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience in
Apache Spark, Databricks, PySpark
, and cloud platforms such as
Azure or AWS
. The role requires a solid background in building scalable
data pipelines, performance optimization, and data governance
.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using
    Apache Spark on Databricks
    .
  • Write efficient and production-ready
    PySpark or Scala code
    for data transformation and ETL processes.
  • Integrate data from various structured and unstructured sources into a unified platform.
  • Implement
    Delta Lake
    and manage data versioning, updates, and schema evolution.
  • Optimize data workflows for
    performance, scalability, and cost efficiency
    .
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.
  • Implement
    data quality checks, validation routines, and logging mechanisms
    .
  • Monitor, debug, and maintain production jobs using
    Databricks jobs, notebooks, and clusters
    .
  • Ensure
    security, privacy, and compliance standards
    throughout the data lifecycle.
  • Provide technical guidance and mentorship to junior engineers.

Required Skills & Qualifications

  • 5–7 years of experience in
    Big Data development
    .
  • Hands-on experience with
    Databricks (Workflows, Notebooks, Delta Live Tables, Unity Catalog)
    .
  • Strong programming skills in
    PySpark and/or Scala
    .
  • Solid understanding of
    Delta Lake architecture
    .
  • Proficiency in
    SQL
    for data analysis and transformation.
  • Experience with cloud platforms such as:
  • Azure
    : Data Lake, Data Factory, Synapse
  • AWS
    : S3, Glue, Redshift
  • Familiarity with
    CI/CD for Databricks deployments
    (GitHub Actions, Azure DevOps).
  • Knowledge of
    data governance, cataloguing, and security best practices
    .
  • Experience working in an
    Agile/Scrum environment
    .

Preferred Skills

  • Experience with
    Databricks Unity Catalog and Delta Live Tables
    .
  • Exposure to
    machine learning workflows
    in Databricks.
  • Experience with orchestration/messaging tools like
    Apache Airflow, Kafka
    .
  • Certifications such as:
  • Databricks Certified Data Engineer Associate/Professional
  • Azure/AWS Certifications


  • Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...

  • Databricks Developer

    3 weeks ago


    Hyderabad, Telangana, India Wipro Full time

    xefxbfxbd Responsibilities will include designing implementing and maintaining the Databricks platform and providing operational support Operational support responsibilities include platform set-up and configuration workspace administration resource monitoring providing technical support to data engineering Data Science ML and Application...


  • Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Databricks Engineer

    2 days ago


    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...


  • Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Databricks Developer - Data Engineer">This is an exciting opportunity to join our team as a Senior Databricks Developer - Data Engineer. We are looking for a highly skilled and experienced professional to lead the development of data engineering solutions using Databricks.The ideal candidate will have a strong background in data...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role: Databricks Solution ArchitectLocation: Kolkata ,Chennai, Kochi (Preferred), Hyderabad, Pune, Bangalore & MumbaiMode: Full TimeRequired Skills:Experience 10 + yearsExperience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.g., Docker, Kubernetes) for deploying data...


  • Hyderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a visionary to lead our Databricks capability, drive technical excellence, and deliver high-impact data and AI/ML solutions. This strategic role is focused on building and scaling our Databricks offering, collaborating with clients, delivery teams, and technology partners to shape our Lakehouse strategy.Key ResponsibilitiesDevelop and enhance...


  • Hyderabad, Telangana, India Mastech Digital Full time

    Title: Capability Lead – DatabricksLocation: Hyderabad, Bangalore and ChennaiEmployment Type: Full-time, Leadership RoleAbout the Role We're seeking a visionary Capability Lead – Databricks to join our Data business leadership team. This strategic role is focused on building and scaling our Databricks capability, driving technical excellence, and...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks Solution ArchitectLocation: Kolkata ,Chennai, Kochi (Preferred), Hyderabad, Pune, Bangalore & MumbaiMode: Full TimeRequired Skills:Experience 10 + yearsExperience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.g., Docker, Kubernetes) for deploying data...

  • Digital: Databricks

    1 week ago


    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Experience: 3-9yearsLocation: HyderabadRequired Technical Skill Set:Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed, mapped, transformed, and...