Senior Databricks Engineer

3 weeks ago

New Delhi, India Newscape Consulting Full time

About the RoleWe are seeking aSenior Databricks Engineerto design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI/ML initiatives.Key ResponsibilitiesDesign & Development: Build and maintain scalable ETL/ELT data pipelines using Apache Spark and Databricks. Develop Delta Lake architectures and optimize data storage for performance and cost. Automate data ingestion, transformation, and orchestration processes across multiple data sources. Build different stages of medallion architecture such as Bronze, Silver and Gold layerData Architecture & Modeling: Collaborate with data architects to design data lakehouse and warehouse solutions. Implement data quality frameworks, versioning, and governance standards (e.g., Unity Catalog). Optimize Spark jobs, cluster configurations, and query performance. Cloud & Infrastructure: Work with Azure Databricks or AWS to configure and manage cloud-based data platforms. Develop and manage CI/CD pipelines for Databricks notebooks, workflows, and jobs. Implement security best practices for data access, encryption, and compliance.Collaboration & Leadership: Partner with data scientists, analysts, and product teams to enable data-driven decisions. Provide technical mentorship to junior engineers. Contribute to strategic planning and architecture reviews.Required Qualifications Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field. 6+ years of experience in data engineering or software development. 4+ years hands-on experience with Databricks and Apache Spark. Strong proficiency in Python, SQL, and PySpark. Experience with Delta Lake, Data Lakehouse, and Data Warehousing concepts. Solid understanding of data modeling, ETL design, medallion architecture and distributed data processing. Familiarity with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins, etc.). Cloud platform expertise in Azure, AWS, or GCP. Preferred Qualifications Experience with machine learning pipelines in Databricks (MLflow). Knowledge of data governance and compliance frameworks. Experience integrating Databricks with BI tools like Power BI, Tableau, or Looker. Certifications such as: Databricks Certified Data Engineer Associate or Professional Azure Data Engineer Associate AWS Big Data Specialty Soft Skills Strong problem-solving and analytical thinking. Excellent communication and collaboration abilities. Proactive mindset with ownership of deliverables. Passion for learning emerging data technologies. Why Join Us Work with cutting-edge data technologies on large-scale projects. Opportunity to shape the organization’s data strategy and architecture. Collaborative and innovative culture focused on continuous growth.

  • Senior Azure Databricks Engineer

    3 weeks ago

    New Delhi, India Newscape Consulting Full time

    We’re Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineerLocation:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based ⏳ Availability:Immediate Joiners / Notice Period ≤ 15 Days ⚠️ Note:Only local Pune candidates may apply. *L2 interviews will be conductedin person— apply only if you are open to face-to-face...

  • Databricks Data Engineer

    1 week ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ yearsLocation: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary:We are looking for 3–4 experienced Databricks Developers to support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in building scalable data pipelines using...

  • Databricks Data Engineer

    3 days ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data Engineer Experience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary: We are looking for3–4 experienced Databricks Developersto support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in buildingscalable data pipelines using...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Delhi, India Newscape Consulting Full time

    We’re Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineerLocation: Baner, Pune (Onsite Only)Work Mode: Full-time | Office-based⏳ Availability: Immediate Joiners / Notice Period ≤ 15 Days⚠️ Note: Only local Pune candidates may apply.* L2 interviews will be conducted in person — apply only if you are open to...

  • Senior Databricks Engineer

    1 week ago

    New Delhi, India SID Information Technologies Full time

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS) Experience:6–12 years Location:Hyderabad Work Mode:Hybrid (3 days/week in-office) Join Time:ImmediateMust-Have Technical Skills: Strong programming skills inPython, Databricks Hands-on experience withApache Spark & Databricksfor big data processing onAWS cloud Proficiency withAWS servicessuch...

  • Databricks Engineer

    1 week ago

    New Delhi, India TTC Group Full time

    Role : Databricks Engineer Position : Remote Type : Contract Duration : 3 - 6 months (extendable)Role OverviewWe are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    1 week ago

    New Delhi, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Sr. Data Engineer

    3 weeks ago

    New Delhi, India xponent.ai Full time

    We are an Australian Data and AI company and are expanding our Databricks Capability in India and are seeking a Senior Databricks Data Engineer to build scalable, production-grade data platforms that enable AI and advanced analytics for our global clients. We are open, transparent, no-nonsense, innovative problem solvers and eternal learners as a team where...

  • Aws Databricks Engineer

    5 days ago

    New Delhi, India People Prime Worldwide Full time

    Job Title: AWS Data engineerLocation: PAN India (Hybrid)Experience: 5–12 Years (STRICTLY)Employment Type: PermanentNotice Period: Immediate Joiners / ≤ 30 Days OnlyCTC:- [5–8 yrs] – Up to 21 LPA - [8–12 yrs] – Up to 26 LPAAbout the CompanyOur client is a global leader in digital transformation and IT services across 50+ countries. They specialize...