Databricks Engineer

6 days ago


Pune, Maharashtra, India Virtusa Full time

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes
  • Integrate data from various structured and unstructured sources into a unified platform
  • Implement Delta Lake and manage data versioning, updates, and schema evolution
  • Optimize data processing workflows for performance, scalability, and cost efficiency
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets
  • Implement data quality checks, validation routines, and logging mechanisms
  • Monitor and debug production jobs using Databricks jobs, notebooks, and clusters
  • Ensure security, privacy, and compliance standards are met throughout the data lifecycle
  • Provide uidance and mentorship to junior team members

Required Skills & Qualifications:

  • 4 to 6 years of experience in Big Data development
  • Hands-on experience with Databricks (including Workflows, Notebooks, Delta Live Tables, Unity Catalog)
  • Strong programming skills in PySpark and/or Scala
  • Solid understanding of Delta Lake architecture
  • Proficient in SQL for data analysis and transformation
  • Experience with cloud platforms such as Azure (Azure Data Lake, Data Factory, Synapse) or AWS (S3, Glue, Redshift)
  • Familiarity with CI/CD for Databricks deployments (e.g, using GitHub Actions, Azure DevOps)
  • Knowledge of data governance, cataloguing, and security best practices
  • Experience working in an Agile/Scrum environment
  • Preferred Skills:Experience with Databricks Unity Catalog and Delta Live Tables
  • Exposure to machine learning workflows in Databricks
  • Experience with Apache Airflow, Kafka, or other orchestration/messaging tools
  • Certifications such as Databricks Certified Data Engineer Associate/Professional, Azure, or AWS certification.

  • Databricks Engineer

    2 weeks ago


    Pune, Maharashtra, India Virtusa Full time

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Databricks

    2 weeks ago


    Pune, Maharashtra, India Cognizant Full time

    AIA-PuneJob SummaryWe are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog Azure Data Lake Store Azure DevOps Python Databricks SQL Databricks Workflows and PySpark. Experience in Data Management Hedge Fund Accounting and Account Management is a plus....

  • Databricks Developer

    2 weeks ago


    Pune, Maharashtra, India BSR & Co Full time

    DescriptionJob Title: Databricks ConsultantLocation: BangaloreExperience: 4-6 Years4-6 years of professional experience in data engineering, with a focus on Databricks.Programming expertise on python, SQL, SparkGood experience on databricks - dealing with data pipelines, medallion architecture, Lakehouse, delta tables, time travel, unity catalog,...


  • Pune, Maharashtra, India Newscape Consulting Full time

    We're Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer Location:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based Availability:Immediate Joiners / Notice Period ≤ 15 Days Note:Only local Pune candidates may apply.* L2 interviews will be conductedin person— apply only if you are open to face-to-face interviews....


  • Pune, Maharashtra, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 5+ yearsLocation: Gurgaon /Pune / BangaloreSkills : Databricks , Delta Lake, PySpark , SQLDesired Skills and Experience:• 3–5 years of experience in data engineering, preferably with Azure Databricks.• Strong technical expertise inPySpark, SQL, and Delta Lake.• Familiarity with Unity Catalog, data...


  • Pune, Maharashtra, India Growel Softech Pvt. Ltd. Full time

    JD for Unity Catalog and Databricks EngineerRole C2HExperience-6 to 9yrs overall,Also experience in Pyspark, DatabricksLocation-PAN INDIA(except Hyderabad and Chennai as preferred location)NP-Immediate/15 daysHybrid-2 or 3 days WFOUnity Catalog Adoption Data Engineer 3-6 Years, PySpark, Databricks, Unity Catalog JD Design, develop, and maintain efficient and...


  • Pune, Maharashtra, India Jade Global Full time

    Position Name : Databricks ArchitectLocation : PuneExperience : Min 12+ yearsAbout Jade GlobalJade Global is a premier global IT services and solutions firm committed to helping clients drive business transformation through enterprise applications, AI/ML, cloud platforms, automation, and managed services. As a trusted partner for industry leaders across...

  • Databricks Engineer

    3 weeks ago


    Pune, Maharashtra, India, Maharashtra ValueMomentum Full time

    Interview Date: 13th December- Walk-in DriveExperience: 5+ Years onlyPlease get your Resume-Hard Copy About the RoleWe are seeking a skilled Databricks Engineer with strong expertise in PySpark, SQL, and cloud-based big data platforms. The ideal candidate will design, develop, and optimize large-scale data pipelines, ensuring high performance and reliability...


  • Pune, Maharashtra, India InfoBeans Full time

    Job Title:Databricks ArchitectLocation:Indore, Pune, Bangalore (Hybrid/Remote options available)Work Timings:2:00 PM to 11:00 PM ISTExperience Level:10 to 15 YearsAbout the RoleWe are seeking a seasoned Databricks Architect to lead the design and implementation of scalable data platforms from scratch. You will architect end-to-end ETL pipelines, optimize...


  • Pune, Maharashtra, India Zensar Full time

    Job Title: Offshore Data Engineer - DatabricksExperience: 5+ YearsAbout the Role:We are seeking an experienced Data Engineer (Databricks) to join our offshore data engineering team. The ideal candidate will have strong expertise in Azure Databricks, data lake architecture, and ETL/ELT pipeline development. This role involves building, optimizing, and...