Databricks Developer

22 hours ago

Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title:
Databricks Developer

Location:
Bangalore, Chennai, Hyderabad, Pune

Experience:
5–7 Years

About the Role

We are seeking an experienced
Databricks Developer
with 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience in
Apache Spark, Databricks, PySpark
, and cloud platforms such as
Azure or AWS
. The role requires a solid background in building scalable
data pipelines, performance optimization, and data governance
.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using
    Apache Spark on Databricks
    .
  • Write efficient and production-ready
    PySpark or Scala code
    for data transformation and ETL processes.
  • Integrate data from various structured and unstructured sources into a unified platform.
  • Implement
    Delta Lake
    and manage data versioning, updates, and schema evolution.
  • Optimize data workflows for
    performance, scalability, and cost efficiency
    .
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.
  • Implement
    data quality checks, validation routines, and logging mechanisms
    .
  • Monitor, debug, and maintain production jobs using
    Databricks jobs, notebooks, and clusters
    .
  • Ensure
    security, privacy, and compliance standards
    throughout the data lifecycle.
  • Provide technical guidance and mentorship to junior engineers.

Required Skills & Qualifications

  • 5–7 years of experience in
    Big Data development
    .
  • Hands-on experience with
    Databricks (Workflows, Notebooks, Delta Live Tables, Unity Catalog)
    .
  • Strong programming skills in
    PySpark and/or Scala
    .
  • Solid understanding of
    Delta Lake architecture
    .
  • Proficiency in
    SQL
    for data analysis and transformation.
  • Experience with cloud platforms such as:
  • Azure
    : Data Lake, Data Factory, Synapse
  • AWS
    : S3, Glue, Redshift
  • Familiarity with
    CI/CD for Databricks deployments
    (GitHub Actions, Azure DevOps).
  • Knowledge of
    data governance, cataloguing, and security best practices
    .
  • Experience working in an
    Agile/Scrum environment
    .

Preferred Skills

  • Experience with
    Databricks Unity Catalog and Delta Live Tables
    .
  • Exposure to
    machine learning workflows
    in Databricks.
  • Experience with orchestration/messaging tools like
    Apache Airflow, Kafka
    .
  • Certifications such as:
  • Databricks Certified Data Engineer Associate/Professional
  • Azure/AWS Certifications

  • Databricks Developer

    1 week ago

    Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...

  • Databricks Architect

    2 days ago

    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Databricks Developer

    2 days ago

    Hyderabad, Telangana, India Milestone Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Databricks Engineer

    2 days ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Databricks Solution Architect

    20 hours ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Databricks Solution ArchitectLocation: Kolkata ,Chennai, Kochi (Preferred), Hyderabad, Pune, Bangalore & MumbaiMode: Full TimeRequired Skills:Experience 10 + yearsExperience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.g., Docker, Kubernetes) for deploying data...

  • Practice Leader –Databricks

    4 weeks ago

    Hyderabad, Telangana, India Mastech Digital Full time

    Title: Capability Lead – DatabricksLocation: Hyderabad, Bangalore and ChennaiEmployment Type: Full-time, Leadership RoleAbout the Role We're seeking a visionary Capability Lead – Databricks to join our Data business leadership team. This strategic role is focused on building and scaling our Databricks capability, driving technical excellence, and...

  • Digital: Databricks

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Experience: 3-9yearsLocation: HyderabadRequired Technical Skill Set:Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed, mapped, transformed, and...

  • Practice Leader –Databricks

    4 weeks ago

    Hyderabad, Telangana, India Mastech Digital Full time

    Title: Capability Lead – Databricks Location: Hyderabad, Bangalore and Chennai Employment Type: Full-time, Leadership Role About the Role We're seeking a visionary Capability Lead – Databricks to join our Data business leadership team. This strategic role is focused on building and scaling our Databricks capability, driving technical excellence,...

  • Digital: Databricks

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Experience: 3-9years Location: Hyderabad Required Technical Skill Set: Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle 3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leads Responsibilities: Assure that data is cleansed, mapped,...

  • Digital: Databricks

    23 hours ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 3-9yearsLocation: HyderabadRequired Technical Skill Set:Spark-SQL, Pyspark, Pandas,DevOps, CI/CD ,as SQL server, Oracle3+ years experienced data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leadsResponsibilities:Assure that data is cleansed, mapped, transformed, and...