Databricks Developer

2 days ago

Hyderabad, India Zetamicron Full time

Job Title:
Databricks Developer

Location:
Bangalore, Chennai, Hyderabad, Pune

Experience:
5–7 Years

About the Role

We are seeking an experienced
Databricks Developer
with 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience in
Apache Spark, Databricks, PySpark
, and cloud platforms such as
Azure or AWS
. The role requires a solid background in building scalable
data pipelines, performance optimization, and data governance
.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using
    Apache Spark on Databricks
    .
  • Write efficient and production-ready
    PySpark or Scala code
    for data transformation and ETL processes.
  • Integrate data from various structured and unstructured sources into a unified platform.
  • Implement
    Delta Lake
    and manage data versioning, updates, and schema evolution.
  • Optimize data workflows for
    performance, scalability, and cost efficiency
    .
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets.
  • Implement
    data quality checks, validation routines, and logging mechanisms
    .
  • Monitor, debug, and maintain production jobs using
    Databricks jobs, notebooks, and clusters
    .
  • Ensure
    security, privacy, and compliance standards
    throughout the data lifecycle.
  • Provide technical guidance and mentorship to junior engineers.

Required Skills & Qualifications

  • 5–7 years of experience in
    Big Data development
    .
  • Hands-on experience with
    Databricks (Workflows, Notebooks, Delta Live Tables, Unity Catalog)
    .
  • Strong programming skills in
    PySpark and/or Scala
    .
  • Solid understanding of
    Delta Lake architecture
    .
  • Proficiency in
    SQL
    for data analysis and transformation.
  • Experience with cloud platforms such as:
  • Azure
    : Data Lake, Data Factory, Synapse
  • AWS
    : S3, Glue, Redshift
  • Familiarity with
    CI/CD for Databricks deployments
    (GitHub Actions, Azure DevOps).
  • Knowledge of
    data governance, cataloguing, and security best practices
    .
  • Experience working in an
    Agile/Scrum environment
    .

Preferred Skills

  • Experience with
    Databricks Unity Catalog and Delta Live Tables
    .
  • Exposure to
    machine learning workflows
    in Databricks.
  • Experience with orchestration/messaging tools like
    Apache Airflow, Kafka
    .
  • Certifications such as:
  • Databricks Certified Data Engineer Associate/Professional
  • Azure/AWS Certifications

  • Databricks Developer

    2 weeks ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks

    2 weeks ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Databricks

    2 days ago

    Hyderabad, India Cognizant Technology Solutions Full time

    Job Summary We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Databricks

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain scalable data processing solutions using Spark in Scala to enhance data analytics capabilities. - Implement and manage Delta Sharing to ensure seamless data exchange across platforms. - Administer Databricks Unity Catalog to maintain data governance and security. - Utilize Databricks CLI for...

  • Databricks

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain scalable data pipelines using Spark in Scala to ensure efficient data processing and transformation. - Implement and manage Delta Sharing to facilitate secure and efficient data sharing across various platforms. - Administer Databricks Unity Catalog to ensure proper data governance and access...

  • Lead Consultant-Databricks developer

    2 days ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities - Design and develop scalable data pipelines using Databricks (PySpark/SQL/Delta Live...

  • Databricks Architect

    2 weeks ago

    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Databricks PySpark Developer

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeePySpark Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Databricks PySpark DeveloperAbout the JobWe are seeking a skilled Databricks PySpark developer to join our team. The ideal candidate will have extensive experience in developing and optimizing data processing jobs using PySpark, as well as designing and implementing robust data pipelines on the AWS platform.Key ResponsibilitiesDevelop and optimize...

  • Consultant-Databricks

    4 days ago

    Hyderabad, India Genpact Full time

    Job Description Inviting applications for the role of Consultant-Databricks! We are on the lookout for an Analytics Engineer to join our team, tasked with integrating Putnam analytics solutions into FT systems. The ideal candidate should have a genuine passion for maintaining, optimizing, and enhancing analytics solutions. Responsibilities Develop and...

  • Databricks Visionary

    2 weeks ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    Senior Databricks ArchitectWe are seeking a highly skilled Senior Databricks Architect to drive technical excellence and deliver high-impact data solutions.Key ResponsibilitiesDevelop and enhance Databricks-based offerings, accelerators, and reusable frameworks.Lead solution architecture for proposals, RFPs, and strategic pursuits.Provide technical oversight...