Databricks Developer

4 weeks ago

Hyderabad, India Zetamicron Full time

Job Title:
Databricks Developer

Location:
Bangalore, Chennai, Hyderabad, Pune

Experience:
5–7 Years

About the Role

We are seeking an experienced
Databricks Developer
with 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience in
Apache Spark, Databricks, PySpark
, and cloud platforms such as
Azure or AWS
. The role requires a solid background in building scalable
data pipelines, performance optimization, and data governance
.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using
    Apache Spark on Databricks
    .
  • Write efficient and production-ready
    PySpark or Scala code
    for data transformation and ETL processes.
  • Integrate data from various structured and unstructured sources into a unified platform.
  • Implement
    Delta Lake
    and manage data versioning, updates, and schema evolution.
  • Optimize data workflows for
    performance, scalability, and cost efficiency
    .
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.
  • Implement
    data quality checks, validation routines, and logging mechanisms
    .
  • Monitor, debug, and maintain production jobs using
    Databricks jobs, notebooks, and clusters
    .
  • Ensure
    security, privacy, and compliance standards
    throughout the data lifecycle.
  • Provide technical guidance and mentorship to junior engineers.

Required Skills & Qualifications

  • 5–7 years of experience in
    Big Data development
    .
  • Hands-on experience with
    Databricks (Workflows, Notebooks, Delta Live Tables, Unity Catalog)
    .
  • Strong programming skills in
    PySpark and/or Scala
    .
  • Solid understanding of
    Delta Lake architecture
    .
  • Proficiency in
    SQL
    for data analysis and transformation.
  • Experience with cloud platforms such as:
  • Azure
    : Data Lake, Data Factory, Synapse
  • AWS
    : S3, Glue, Redshift
  • Familiarity with
    CI/CD for Databricks deployments
    (GitHub Actions, Azure DevOps).
  • Knowledge of
    data governance, cataloguing, and security best practices
    .
  • Experience working in an
    Agile/Scrum environment
    .

Preferred Skills

  • Experience with
    Databricks Unity Catalog and Delta Live Tables
    .
  • Exposure to
    machine learning workflows
    in Databricks.
  • Experience with orchestration/messaging tools like
    Apache Airflow, Kafka
    .
  • Certifications such as:
  • Databricks Certified Data Engineer Associate/Professional
  • Azure/AWS Certifications

  • Databricks

    4 weeks ago

    Hyderabad, India Cognizant Technology Solutions Full time

    Job Summary We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Databricks

    2 weeks ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Databricks

    2 weeks ago

    Hyderabad, India Talent Worx Full time

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential. We are seeking highly skilled Databricks Data Engineers to...

  • AWS Databricks Developer

    1 day ago

    Bengaluru, Hyderabad, India Coforge Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...

  • Lead Consultant-Databricks developer

    4 weeks ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities - Design and develop scalable data pipelines using Databricks (PySpark/SQL/Delta Live...

  • Databricks+spark

    7 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

  • Databricks - Architect

    2 weeks ago

    Hyderabad, India Tiger Analytics Full time

    Job Description We are seeking a highly skilled and experienced Databricks Expert/Architect to join our global data services team. This individual will play a key role in designing, implementing, and optimizing Databricks solutions across our organization. The ideal candidate will have deep expertise in Databricks architecture, development, security,...

  • Databricks - Architect

    2 weeks ago

    Hyderabad, India Tiger Analytics Full time

    Job Description We are seeking a highly skilled and experienced Databricks Expert/Architect to join our global data services team. This individual will play a key role in designing, implementing, and optimizing Databricks solutions across our organization. The ideal candidate will have deep expertise in Databricks architecture, development,...

  • Consultant-Databricks

    4 weeks ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Consultant-Databricks! We are on the lookout for an Analytics Engineer to join our team, tasked with integrating Putnam analytics solutions into FT systems. The ideal candidate should have a genuine passion for maintaining, optimizing, and enhancing analytics solutions. Responsibilities Develop and...

  • Principal Consultant, Sr. Databricks Developer!

    1 week ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Principal Consultant, Sr. Databricks Developer! In this role, the Sr. Databricks developer is responsible for solving real world cutting edgeproblem andmentor a team of one or more junior developer to address the goal. Responsibilities - Design and develop end-to-end data pipelines using PySpark,...