Senior Databricks Engineer

2 days ago

New Delhi, India Newscape Consulting Full time

About the RoleWe are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a hands-on expert in data engineering, cloud infrastructure, and distributed data processing, with a deep understanding of how to build reliable and performant data ecosystems to power business insights and AI/ML initiatives.Key ResponsibilitiesDesign &- Development: - Build and maintain scalable ETL/ELT data pipelines using Apache Spark and Databricks. - Develop Delta Lake architectures and optimize data storage for performance and cost. - Automate data ingestion, transformation, and orchestration processes across multiple data sources. - Build different stages of medallion architecture such as Bronze, Silver and Gold layerData Architecture & Modeling:- Collaborate with data architects to design data lakehouse and warehouse solutions. - Implement data quality frameworks, versioning, and governance standards (e.g., Unity Catalog). - Optimize Spark jobs, cluster configurations, and query performance. - Cloud & Infrastructure: - Work with Azure Databricks or AWS to configure and manage cloud-based data platforms. - Develop and manage CI/CD pipelines for Databricks notebooks, workflows, and jobs. - Implement security best practices for data access, encryption, and compliance.Collaboration & Leadership:- Partner with data scientists, analysts, and product teams to enable data-driven decisions. - Provide technical mentorship to junior engineers. - Contribute to strategic planning and architecture reviews.Required Qualifications- Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field. - 6+ years of experience in data engineering or software development. - 4+ years hands-on experience with Databricks and Apache Spark. - Strong proficiency in Python, SQL, and PySpark. - Experience with Delta Lake, Data Lakehouse, and Data Warehousing concepts. - Solid understanding of data modeling, ETL design, medallion architecture and distributed data processing. - Familiarity with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins, etc.). - Cloud platform expertise in Azure, AWS, or GCP.Preferred Qualifications- Experience with machine learning pipelines in Databricks (MLflow). - Knowledge of data governance and compliance frameworks. - Experience integrating Databricks with BI tools like Power BI, Tableau, or Looker. - Certifications such as: - Databricks Certified Data Engineer Associate or Professional - Azure Data Engineer Associate - AWS Big Data SpecialtySoft Skills- Strong problem-solving and analytical thinking. - Excellent communication and collaboration abilities. - Proactive mindset with ownership of deliverables. - Passion for learning emerging data technologies.Why Join Us- Work with cutting-edge data technologies on large-scale projects. - Opportunity to shape the organization’s data strategy and architecture. - Collaborative and innovative culture focused on continuous growth.

  • Databricks Senior Developer

    3 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Role: Databricks Senior DeveloperLocation: KolkataExperience: 8 Plus YearsRole**Databricks Senior DeveloperRequired Technical Skill Set**Databricks, Spark and Data Migration experienceDesired Competencies (Technical/Behavioral Competency)Must-Have**1. 8+ years with strong Databricks, Spark and Data Migration experience2. Should have experience of end-to-end...

  • Databricks Data Engineer

    4 weeks ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ yearsLocation: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary:We are looking for 3–4 experienced Databricks Developers to support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in building scalable data pipelines using...

  • Data Engineer

    3 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS is hiring Data Engineer (Databricks) Location – PAN INDIA Years of Experience – 10-16 yearsJob DescriptionRole- Senior Data Engineer – DatabricksRequired Technical Skill Set Databricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOpsDesired Competencies Must-Have Expertise in building...

  • Databricks Data Engineer

    3 weeks ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data Engineer Experience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary: We are looking for3–4 experienced Databricks Developersto support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in buildingscalable data pipelines using...

  • Databricks Data Engineer

    2 weeks ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary: We are looking for3–4 experienced Databricks Developersto support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in buildingscalable data pipelines using...

  • Data Engineer

    4 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS is hiring Data Engineer (Databricks)Location – PAN INDIAYears of Experience – 10-16 yearsJob DescriptionRole - Senior Data Engineer – DatabricksRequired Technical Skill SetDatabricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOpsDesired CompetenciesMust-Have- Expertise in building...

  • Databricks Engineer

    3 weeks ago

    New Delhi, India KPG99 INC Full time

    Databricks EngineerLocation: REMOTEDuration: 12 months with extensionsOpenings: 3REQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles- Strong hands-on experience with Databricks for data processing and pipeline development.- Proficiency in SQL for data querying, transformation, and troubleshooting.- Solid programming skills in...

  • Databricks Engineer

    3 weeks ago

    New Delhi, India Sapphire Software Solutions Inc Full time

    HI Folks Please check the JD and share your updated resume to my email naresh@sapphiresoftwaresolutions.com and ping me on whatsapp (+91 970-529-6474) along with your resume Databricks Engineer Location: REMOTE Duration: 12 months with extensions Openings: 3 REQUIRED SKILLS AND EXPERIENCE - 3–5 years of experience in data engineering roles - Strong...

  • Databricks Engineer

    2 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Databricks Engineer Job Location: Chennai (ONLY) Experience required : 6-10 yrsVirtual Interview Date: 25-Oct-25 (Saturday)Must-Have Data Engineer having , Databricks & AWS development experience Development experience in Python, Pyspark Hands-on experience in writing complex SQLs and performance optimization of very...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India Accolade Full time

    About AccoladeThe multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront. We are building the industry's first AI-native Operations Centralization Platform, designed to streamline complex processes, unlock new efficiencies, and create better experiences for residents and operators alike. Our platform uses...