Senior Databricks Engineer

3 weeks ago

New Delhi, India Newscape Consulting Full time

About the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI/ML initiatives.Key ResponsibilitiesDesign &- Development: - Build and maintain scalable ETL/ELT data pipelines using Apache Spark and Databricks. - Develop Delta Lake architectures and optimize data storage for performance and cost. - Automate data ingestion, transformation, and orchestration processes across multiple data sources. - Build different stages of medallion architecture such as Bronze, Silver and Gold layerData Architecture & Modeling:- Collaborate with data architects to design data lakehouse and warehouse solutions. - Implement data quality frameworks, versioning, and governance standards (e.g., Unity Catalog). - Optimize Spark jobs, cluster configurations, and query performance. - Cloud & Infrastructure: - Work with Azure Databricks or AWS to configure and manage cloud-based data platforms. - Develop and manage CI/CD pipelines for Databricks notebooks, workflows, and jobs. - Implement security best practices for data access, encryption, and compliance.Collaboration & Leadership:- Partner with data scientists, analysts, and product teams to enable data-driven decisions. - Provide technical mentorship to junior engineers. - Contribute to strategic planning and architecture reviews.Required Qualifications- Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field. - 6+ years of experience in data engineering or software development. - 4+ years hands-on experience with Databricks and Apache Spark. - Strong proficiency in Python, SQL, and PySpark. - Experience with Delta Lake, Data Lakehouse, and Data Warehousing concepts. - Solid understanding of data modeling, ETL design, medallion architecture and distributed data processing. - Familiarity with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins, etc.). - Cloud platform expertise in Azure, AWS, or GCP.Preferred Qualifications- Experience with machine learning pipelines in Databricks (MLflow). - Knowledge of data governance and compliance frameworks. - Experience integrating Databricks with BI tools like Power BI, Tableau, or Looker. - Certifications such as: - Databricks Certified Data Engineer Associate or Professional - Azure Data Engineer Associate - AWS Big Data SpecialtySoft Skills- Strong problem-solving and analytical thinking. - Excellent communication and collaboration abilities. - Proactive mindset with ownership of deliverables. - Passion for learning emerging data technologies.Why Join Us- Work with cutting-edge data technologies on large-scale projects. - Opportunity to shape the organization’s data strategy and architecture. - Collaborative and innovative culture focused on continuous growth.

  • Senior Azure Databricks Engineer

    2 weeks ago

    New Delhi, India Newscape Consulting Full time

    We’re Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineerLocation:Baner, Pune (Onsite Only) Work Mode:Full-time | Office-based ⏳ Availability:Immediate Joiners / Notice Period ≤ 15 Days ⚠️ Note:Only local Pune candidates may apply. *L2 interviews will be conductedin person— apply only if you are open to face-to-face...

  • Databricks Data Engineer

    1 week ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ yearsLocation: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary:We are looking for 3–4 experienced Databricks Developers to support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in building scalable data pipelines using...

  • Databricks Data Engineer

    2 days ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data Engineer Experience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary: We are looking for3–4 experienced Databricks Developersto support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in buildingscalable data pipelines using...

  • Senior Azure Databricks Engineer

    2 weeks ago

    Delhi, India Newscape Consulting Full time

    We’re Hiring: Senior Databricks Engineer / Azure Data Engineer / Lead Data engineerLocation: Baner, Pune (Onsite Only)Work Mode: Full-time | Office-based⏳ Availability: Immediate Joiners / Notice Period ≤ 15 Days⚠️ Note: Only local Pune candidates may apply.* L2 interviews will be conducted in person — apply only if you are open to...

  • Senior Databricks Engineer

    1 week ago

    New Delhi, India SID Information Technologies Full time

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS) Experience:6–12 years Location:Hyderabad Work Mode:Hybrid (3 days/week in-office) Join Time:ImmediateMust-Have Technical Skills: Strong programming skills inPython, Databricks Hands-on experience withApache Spark & Databricksfor big data processing onAWS cloud Proficiency withAWS servicessuch...

  • Databricks Engineer

    7 days ago

    New Delhi, India TTC Group Full time

    Role : Databricks Engineer Position : Remote Type : Contract Duration : 3 - 6 months (extendable)Role OverviewWe are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data...

  • Senior Data Engineer

    2 weeks ago

    New Delhi, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    7 days ago

    New Delhi, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Sr. Data Engineer

    3 weeks ago

    New Delhi, India xponent.ai Full time

    We are an Australian Data and AI company and are expanding our Databricks Capability in India and are seeking a Senior Databricks Data Engineer to build scalable, production-grade data platforms that enable AI and advanced analytics for our global clients. We are open, transparent, no-nonsense, innovative problem solvers and eternal learners as a team where...

  • Aws Databricks Engineer

    4 days ago

    New Delhi, India People Prime Worldwide Full time

    Job Title: AWS Data engineerLocation: PAN India (Hybrid)Experience: 5–12 Years (STRICTLY)Employment Type: PermanentNotice Period: Immediate Joiners / ≤ 30 Days OnlyCTC:- [5–8 yrs] – Up to 21 LPA - [8–12 yrs] – Up to 26 LPAAbout the CompanyOur client is a global leader in digital transformation and IT services across 50+ countries. They specialize...