Sr. Databricks Engineer

4 weeks ago

Ahmedabad, India XpertNest Full time

We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, PySpark, and SQL , and can work across diverse data sources in a modern cloud environment.


Key Responsibilities

  • Design, build, and maintain data pipelines and workflows on Databricks.
  • Implement data transformations, aggregations, and validations for large datasets.
  • Work with structured, semi-structured, and unstructured data across multiple sources.
  • Optimize Databricks jobs for performance, scalability, and cost efficiency .
  • Collaborate with stakeholders to understand business requirements and deliver data-driven solutions.
  • Ensure data integrity, security, and compliance across all processes.
  • Document solutions, workflows, and provide knowledge transfer to team members.
  • Stay updated with the latest Databricks and cloud ecosystem features .

Required Skills & Qualifications

  • Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or equivalent experience.
  • Proven hands-on experience (X+ years) with Databricks and Apache Spark (PySpark/Scala) .
  • Strong proficiency in SQL and data modeling.
  • Experience with Delta Lake and modern data lakehouse architectures .
  • Familiarity with cloud platforms (Azure, AWS, or GCP).
  • Understanding of data governance, lineage, and role-based security .
  • Ability to work in agile teams and communicate effectively with both technical and business stakeholders.

Nice to Have

  • Experience with orchestration tools (Airflow, Azure Data Factory, AWS Glue).
  • Exposure to real-time/streaming data (Kafka, EventHub, Kinesis).
  • Knowledge of CI/CD for data pipelines and Infrastructure-as-Code (Terraform, ARM templates).
  • Familiarity with data warehouse solutions (Snowflake, BigQuery, Redshift).

  • Sr. databricks engineer

    4 weeks ago

    Ahmedabad, India XpertNest Full time

    We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, Py Spark, and SQL , and can...

  • Sr. Databricks Engineer

    4 weeks ago

    Ahmedabad, India XpertNest Full time

    We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, PySpark, and SQL , and can work...

  • Sr. Databricks Engineer

    4 weeks ago

    Ahmedabad, India XpertNest Full time

    We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, PySpark, and SQL , and can work...

  • Sr. Databricks Engineer

    4 weeks ago

    Ahmedabad, India XpertNest Full time

    We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, PySpark, and SQL, and can work across...

  • Sr. Databricks Engineer

    4 weeks ago

    Ahmedabad, India XpertNest Full time

    We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, PySpark, and SQL, and can work across...

  • Sr. Databricks Engineer

    4 weeks ago

    Ahmedabad, India XpertNest Full time

    We are looking for an experienced Databricks Engineer to join our data engineering team. The role involves designing, building, and optimizing data pipelines and workflows on Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience with Spark, PySpark, and SQL, and can work across...

  • Sr. Databricks Engineer

    1 week ago

    Ahmedabad, Gujarat, India XpertNest Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are looking for an experiencedDatabricks Engineerto join our data engineering team. The role involves designing, building, and optimizingdata pipelines and workflowson Databricks, ensuring scalability, performance, and reliability for enterprise-grade projects. The ideal candidate has strong experience withSpark, PySpark, and SQL, and can work across...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, India Arting Digital Full time

    Posting title : Sr. Data Engineer (Databricks)Experience : 5+ YearsLocation : Pune/ AhmedabadWork mode : HybridPrimary skills : Databricks, Data Modelling/ Data Lakehouse, SQL, Python/Scala, Azure Data Factory (ADF)/AWS GlueQualification : Any Technical DegreeRoles & Responsibilities :- Data Architecture & Development : Lead the design, development, and...

  • Databricks Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Steady Rabbit Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks Data EngineerExperience Level: 5 to 7 YearsLocation: AhmedabadEmployment Type: Full-TimeCertifications Required:Databricks Certified Data Engineer AssociateDatabricks Certified Data Engineer ProfessionalCloud Certifications (Preferred): Azure, AWS, GCPJob Summary:We are seeking a highly skilled and certified Databricks Data Engineer to...

  • Sr SQL Test Engineer

    2 days ago

    Ahmedabad, Gujarat, India Gray Acumen Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Sr SQL Test Engineer Databricks (Data Migration)Location: Remote Experience: 5+ YearsEmployment Type: Contract 2 months (Can Extend )Job OverviewWe are seeking a highly skilled SQL Test Engineer with advanced SQL expertise and strong experience in data validation for data migration projects to Databricks. The ideal candidate will have hands-on...