Senior Databricks Engineer

2 days ago

Pune, Maharashtra, India Newscape Consulting Full time US$ 80,000 - US$ 1,20,000 per year

About the Role

We are seeking a 
Senior Databricks Engineer
 to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI/ML initiatives.

Key Responsibilities

  • Design & Development:
  • Build and maintain scalable ETL/ELT data pipelines using 
    Apache Spark
     and 
    Databricks
    .
  • Develop 
    Delta Lake
     architectures and optimize data storage for performance and cost.
  • Automate data ingestion, transformation, and orchestration processes across multiple data sources.
  • Build different stages of medallion architecture such as Bronze, Silver and Gold layer
  • Data Architecture & Modeling:
  • Collaborate with data architects to design data lakehouse and warehouse solutions.
  • Implement 
    data quality frameworks
    , versioning, and governance standards (e.g., Unity Catalog).
  • Optimize Spark jobs, cluster configurations, and query performance.
  • Cloud & Infrastructure:
  • Work with 
    Azure Databricks or AWS
     to configure and manage cloud-based data platforms.
  • Develop and manage CI/CD pipelines for Databricks notebooks, workflows, and jobs.
  • Implement security best practices for data access, encryption, and compliance.
  • Collaboration & Leadership:
  • Partner with data scientists, analysts, and product teams to enable data-driven decisions.
  • Provide technical mentorship to junior engineers.
  • Contribute to strategic planning and architecture reviews.

Required Qualifications

  • Bachelor's or Master's degree in 
    Computer Science
    , 
    Information Systems
    , 
    Engineering
    , or related field.
  • 6+ years
     of experience in data engineering or software development.
  • 4+ years
     hands-on experience with 
    Databricks
     and 
    Apache Spark
    .
  • Strong proficiency in 
    Python
    , 
    SQL
    , and 
    PySpark
    .
  • Experience with 
    Delta Lake
    , 
    Data Lakehouse
    , and 
    Data Warehousing
     concepts.
  • Solid understanding of 
    data modeling
    , 
    ETL design
    ,
    medallion architecture
    and 
    distributed data processing
    .
  • Familiarity with 
    CI/CD tools
     (Azure DevOps, GitHub Actions, Jenkins, etc.).
  • Cloud platform expertise in 
    Azure
    , 
    AWS
    , or 
    GCP
    .

Preferred Qualifications

  • Experience with 
    machine learning pipelines
     in Databricks (MLflow).
  • Knowledge of 
    data governance
     and 
    compliance frameworks
    .
  • Experience integrating Databricks with BI tools like 
    Power BI
    , 
    Tableau
    , or 
    Looker
    .
  • Certifications such as:
  • Databricks Certified Data Engineer Associate or Professional
  • Azure Data Engineer Associate
  • AWS Big Data Specialty

Soft Skills

  • Strong problem-solving and analytical thinking.
  • Excellent communication and collaboration abilities.
  • Proactive mindset with ownership of deliverables.
  • Passion for learning emerging data technologies.

Why Join Us

  • Work with cutting-edge data technologies on large-scale projects.
  • Opportunity to shape the organization's data strategy and architecture.
  • Collaborative and innovative culture focused on continuous growth.

  • Senior Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Newscape Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We're Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face interviews....

  • Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Bitwise Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Role: DataBricks EngineerNotice Period: Immediate joiners onlyLocation: PuneWork Mode: HybridPosition Overview:We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a...

  • Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 6,00,000 - ₹ 24,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:6ctc 6+ upto 24 lacSkill Set:Databricks Engineer, Azure Databricks, SQL, PythonSkill to Evaluate:Databricks Engineer, Azure Databricks, SQL,Pyspark, Python, Team HandlingExperience:8 to 14 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design,...

  • Azure Databricks Engineer

    4 days ago

    Pune, Maharashtra, India Savi Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Opening: Azure Databricks EngineerLocation: Pune, Maharashtra (Onsite)Experience Range: 5-6 YearsApply at: -Required Skills:Azure Data Factory (ADF)PySparkAzure Databricks (ADB)SQLJob Description:We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in:Databricks engineering &...

  • Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Virtusa Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Azure Databricks Developer

    5 days ago

    Pune, Maharashtra, India Newscape Consulting Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    We're Hiring: Senior Databricks Engineer / Azure Data Engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates or those willing to relocate to Pune may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face...

  • Databricks Solution Architect

    5 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Databricks Solution ArchitectExperience: 10+ yearsAbout UsAt Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with...

  • Databricks Solution Architect

    6 days ago

    Pune, Maharashtra, India Codvo Full time ₹ 1,00,00,000 - ₹ 2,50,00,000 per year

    Job Title: Databricks Solution ArchitectExperience: 10+ yearsAbout UsAt Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges...

  • Azure Databricks

    1 week ago

    Pune, Maharashtra, India viraaj hr solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Position: Azure Databricks Engineer (On-site, India)About the OpportunityWe are hiring on behalf of a client seeking an experienced Azure Databricks Engineer to build and operate production-grade data platforms. The role sits at the intersection of data engineering, cloud infrastructure, and analytics—delivering scalable ETL/ELT pipelines, performant...

  • Unity Catalog and Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Growel Softech Pvt. Ltd. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    JD for Unity Catalog and Databricks EngineerRole C2HExperience-6 to 9yrs overall,Also experience in Pyspark, DatabricksLocation-PAN INDIA(except Hyderabad and Chennai as preferred location)NP-Immediate/15 daysHybrid-2 or 3 days WFOUnity Catalog Adoption Data Engineer 3-6 Years, PySpark, Databricks, Unity Catalog JD Design, develop, and maintain efficient and...