Databricks Developer

2 days ago

Chennai, India VySystems Full time

Job Title: Databricks Developer

Notice Period: Immediate to 15 Days

Location: Pan India (Remote)

Experiences: 5 to 9 Years

Job Summary

We are seeking a highly skilled
Databricks Developer
with expertise in
Python, PySpark, API Design, Azure, Airflow, and SQL
. The ideal candidate will design, build, and optimize large-scale data processing solutions, ensuring high performance, reliability, and scalability. You will collaborate with cross-functional teams to deliver modern data-driven solutions on the cloud.

Roles and Responsibilities

  • Design, develop, and maintain
    data pipelines
    using
    Databricks, PySpark, and SQL
    .
  • Implement
    ETL/ELT solutions
    for large-scale structured and unstructured datasets.
  • Build and optimize
    data workflows
    leveraging
    Airflow
    for orchestration.
  • Design and develop
    RESTful APIs
    for data integration and consumption.
  • Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
  • Ensure performance tuning, data quality, and reliability across pipelines.
  • Work with
    Azure cloud services
    (e.g., Data Lake, Synapse, Key Vault, Event Hub) to build scalable solutions.
  • Implement
    CI/CD pipelines
    and follow best practices in code management and deployment.
  • Troubleshoot, debug, and optimize workflows to improve efficiency and reduce costs.
  • Document processes, design decisions, and solutions for future reference.

Required Skills & Experience

  • 3–7 years
    of hands-on experience as a
    Data Engineer / Databricks Developer
    .
  • Strong expertise in
    Databricks, PySpark, and SQL
    for data processing and transformation.
  • Proficiency in
    Python programming
    for data engineering and automation tasks.
  • Experience with
    Airflow
    (or similar orchestration tools) for scheduling and monitoring pipelines.
  • Solid understanding of
    API design and development
    (REST/GraphQL).
  • Proven experience with
    Azure Cloud
    data services (Azure Data Lake, Synapse, Data Factory, Event Hub).
  • Strong knowledge of
    data modeling, performance tuning, and optimization techniques
    .
  • Familiarity with
    DevOps practices, CI/CD, Git, and containerization (Docker/Kubernetes)
    is a plus.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Strong communication and collaboration skills to work with both technical and non-technical stakeholders.

  • Databricks Developer

    2 days ago

    Chennai, India Tekskills Full time

    Job Description:• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer• Data Modeling: Design and optimize...

  • Databricks Developers

    2 days ago

    Chennai, India Cynosure Corporate Solutions Full time

    Key Responsibilities: Develop and optimize data pipelines in Databricks for transforming and processing data from various sources. Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.). Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures. Perform data analysis to identify...

  • Databricks Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a key contributor, you will be responsible for designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.Key ResponsibilitiesDesign and develop efficient data pipelines and workflows in Databricks.Optimize Spark jobs to...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks

    2 days ago

    Chennai, India Cognizant Technology Solutions Full time

    Job Summary Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks Developer

    2 days ago

    Chennai, India Ignitho Full time

    Job Title: Databricks Developer Experience: 2 to 4 Years Job Summary We are seeking a skilled Databricks Developer with 2 to 4 years of experience to design and implement scalable, high-performance data solutions across cloud and on-premise environments. The ideal candidate will have hands-on experience in data modeling, SQL development, and ETL processes,...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Lead the design and implementation of data processing pipelines using Spark in Scala and PySpark - Oversee the administration of Databricks Unity Catalog and manage data governance - Provide expertise in Delta Sharing and ensure secure data sharing practices - Develop and maintain Databricks CLI scripts for automation...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will...

  • Databricks Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Azure Databricks Developer

    1 week ago

    Chennai, Coimbatore, Kolkata, India Ltimindtree Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Mandate Skills: Databricks, Datafactory, Pyspark, SQLResponsibility:5+ Years of experience using Azure.Strong proficiency in Databricks.Experience with Pyspark.Proficiency in SQL or TSQL.Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server.Databricks Jobs for efficient data processing ETL tasks and...