Senior Databricks Engineer

11 hours ago

Pune, Maharashtra, India Newscape Consulting Full time US$ 80,000 - US$ 1,20,000 per year

About the Role

We are seeking a 
Senior Databricks Engineer
 to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI/ML initiatives.

Key Responsibilities

  • Design & Development:
  • Build and maintain scalable ETL/ELT data pipelines using 
    Apache Spark
     and 
    Databricks
    .
  • Develop 
    Delta Lake
     architectures and optimize data storage for performance and cost.
  • Automate data ingestion, transformation, and orchestration processes across multiple data sources.
  • Build different stages of medallion architecture such as Bronze, Silver and Gold layer
  • Data Architecture & Modeling:
  • Collaborate with data architects to design data lakehouse and warehouse solutions.
  • Implement 
    data quality frameworks
    , versioning, and governance standards (e.g., Unity Catalog).
  • Optimize Spark jobs, cluster configurations, and query performance.
  • Cloud & Infrastructure:
  • Work with 
    Azure Databricks or AWS
     to configure and manage cloud-based data platforms.
  • Develop and manage CI/CD pipelines for Databricks notebooks, workflows, and jobs.
  • Implement security best practices for data access, encryption, and compliance.
  • Collaboration & Leadership:
  • Partner with data scientists, analysts, and product teams to enable data-driven decisions.
  • Provide technical mentorship to junior engineers.
  • Contribute to strategic planning and architecture reviews.

Required Qualifications

  • Bachelor's or Master's degree in 
    Computer Science
    , 
    Information Systems
    , 
    Engineering
    , or related field.
  • 6+ years
     of experience in data engineering or software development.
  • 4+ years
     hands-on experience with 
    Databricks
     and 
    Apache Spark
    .
  • Strong proficiency in 
    Python
    , 
    SQL
    , and 
    PySpark
    .
  • Experience with 
    Delta Lake
    , 
    Data Lakehouse
    , and 
    Data Warehousing
     concepts.
  • Solid understanding of 
    data modeling
    , 
    ETL design
    ,
    medallion architecture
    and 
    distributed data processing
    .
  • Familiarity with 
    CI/CD tools
     (Azure DevOps, GitHub Actions, Jenkins, etc.).
  • Cloud platform expertise in 
    Azure
    , 
    AWS
    , or 
    GCP
    .

Preferred Qualifications

  • Experience with 
    machine learning pipelines
     in Databricks (MLflow).
  • Knowledge of 
    data governance
     and 
    compliance frameworks
    .
  • Experience integrating Databricks with BI tools like 
    Power BI
    , 
    Tableau
    , or 
    Looker
    .
  • Certifications such as:
  • Databricks Certified Data Engineer Associate or Professional
  • Azure Data Engineer Associate
  • AWS Big Data Specialty

Soft Skills

  • Strong problem-solving and analytical thinking.
  • Excellent communication and collaboration abilities.
  • Proactive mindset with ownership of deliverables.
  • Passion for learning emerging data technologies.

Why Join Us

  • Work with cutting-edge data technologies on large-scale projects.
  • Opportunity to shape the organization's data strategy and architecture.
  • Collaborative and innovative culture focused on continuous growth.

  • Senior Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Newscape Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're Hiring: Senior Databricks Engineer / Azure Data EngineerLocation:Baner, PuneWork Mode:OnsiteAvailability:Immediate Joiners / 15 Days NPAre you passionate about buildingscalable, high-performance data platforms?We're looking for aSenior Databricks Engineer / Azure Data Engineerto join our growing team and work oncutting-edge Azure Data Engineering...

  • Senior Azure Databricks Engineer

    3 hours ago

    Pune, Maharashtra, India T&N Business Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole :Senior Azure Databricks EngineerExp :8 to 12 yrsLocation :Pune/IndoreNotice Period:Immediate to 30 DaysMust-have skills :Azure Databricks heavyYou will play a key role in...

  • Senior Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India TN BUSINESS SERVICES PRIVATE LIMITED Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the job : We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole : Senior Azure Databricks EngineerExp : 8 to 12 yrsLocation : Pune/IndoreNotice Period : Immediate to 30 DaysMust-have skills : Azure Databricks heavy You will...

  • Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Bitwise Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: DataBricks EngineerNotice Period: Immediate joiners onlyLocation: PuneWork Mode: HybridPosition Overview:We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a...

  • Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:5Maximum Experience:12ctc lac lac maxSkill Set:Databricks Engineer, Azure Databricks, SQL, PysparkSkill to Evaluate:Databricks Engineer, Azure Databricks, SQLExperience:5 to 12 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design, build, and...

  • Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 6,00,000 - ₹ 24,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:6ctc 6+ upto 24 lacSkill Set:Databricks Engineer, Azure Databricks, SQL, PythonSkill to Evaluate:Databricks Engineer, Azure Databricks, SQL,Pyspark, Python, Team HandlingExperience:8 to 14 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design,...

  • Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India InfoCepts Full time ₹ 5,00,000 - ₹ 25,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Data Engineer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary:We are looking for 3–4 experienced Databricks Developers to support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in building scalable data pipelines using...

  • Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time ₹ 12,00,000 - ₹ 20,00,000 per year

    About Position:We are seeking data bricks engineer with hands on experience in Power BI, python, spark and data bricks.Role: Databricks EngineerLocation: Pune & MumbaiExperience: 8 to 12 YearsJob Type: Full Time EmploymentWhat You'll Do:3+ years of experience in data engineering or analytics roles.Strong hands-on experience with Databricks and Apache...

  • Senior AWS Databricks Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Sapphire Manpower Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Candidate should have experience in Data Engineering with AWS Databricks Please don't require Azure Databricks