Databricks Data Engineer Lead

10 hours ago

bangalore, India Blue Cloud Softech Solutions Limited Full time

Job Summary: BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative. The engineer will be responsible for building data pipelines and models to support product-level carbon footprint analysis. This role involves integrating structured engineering, manufacturing, and supplier data into a unified model using Databricks on AWS. Key Responsibilities: • Develop and optimize ETL/ELT pipelines on Databricks using PySpark and SQL to support carbon footprint analytics. • Build data models that combine engineering (EBOM), manufacturing (MBOM), supplier, and factory operations data to generate emissions metrics. • Integrate and transform data from: • MBOM from SAP, including multilevel BOM explosion logic • EBOM from Oracle-based systems (no explosion required)• Supplier environmental data (e.g., material-level emissions)• Factory data (e.g., energy consumption, material usage)• Collaborate with sustainability analysts, engineering teams, and supply chain stakeholders to translate carbon calculation logic into data transformations. • Ensure high data quality, lineage, and governance using Delta Lake, Unity Catalog, and standard best practices. • Leverage AWS services such as S3, Glue, and Athena for orchestration and storage. • Document data logic and workflows for traceability and compliance with ESG standards. Technical Requirements : • Hands-on experience with Databricks (Delta Lake, Unity Catalog, Jobs, Workflows)• Strong skills in PySpark and SQL • Experience with SAP MBOM structures, especially multilevel BOM explosion • Understanding of Oracle-based EBOM systems and ability to integrate structured data • Familiarity with AWS data ecosystem (S3, Glue, Lambda, Athena)• Strong knowledge of data modeling, pipeline optimization, and performance tuning Preferred Qualifications: • Experience in carbon accounting, lifecycle analysis, or sustainability-focused data projects • Understanding of manufacturing data and supply chain operations • Exposure to SAP ECC/S/4HANA and Oracle-based PLM or engineering systems • Experience with version control, CI/CD (e.g., Git, Databricks Repos)

  • Databricks Lead

    7 hours ago

    bangalore, India Mastech Digital Full time

    Job Title: Databricks Lead Location: Chennai/Hyderabad/BangaloreExperience: 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projectsBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are looking for a highly skilled Databricks Lead...

  • Lead Data Engineer

    4 weeks ago

    bangalore, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Databricks Data Engineer

    8 hours ago

    bangalore, India Squash Apps Full time

    Company DescriptionSquash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies, including MEAN, MERN, MEVN stack, Java stack, SQL/NoSQL, Elastic Search, Redis, and hybrid mobile applications. With innovative projects...

  • Sr. Data Engineer

    4 weeks ago

    bangalore, India xponent.ai Full time

    We are an Australian Data and AI company and are expanding our Databricks Capability in India and are seeking a Senior Databricks Data Engineer to build scalable, production-grade data platforms that enable AI and advanced analytics for our global clients. We are open, transparent, no-nonsense, innovative problem solvers and eternal learners as a team where...

  • Azure Databricks Data Engineer

    1 week ago

    bangalore, India Onebridge Full time

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Databricks Data Engineer Lead – Sustainability Project

    2 weeks ago

    bangalore, India Blue Cloud Softech Solutions Limited Full time

    Job Summary:BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative. The engineer will be responsible for building data pipelines and models to support product-level carbon footprint analysis. This role involves integrating structured engineering, manufacturing, and supplier data into a unified model using...

  • Databricks Data Engineer

    6 days ago

    bangalore, India beBeeData Full time

    Design and develop scalable data pipelines using Azure Databricks in this key role at Tata Consultancy Services (TCS). Key responsibilities include building ETL/ELT pipelines, implementing Lakehouse frameworks, optimizing Spark jobs for performance and cost efficiency, ingesting data from multiple sources, and working with Azure Data Lake and Azure Data...

  • Data Engineer with Databricks

    2 weeks ago

    bangalore, India iitjobs, Inc. Full time

    Greetings!!!Role:- Data Engineer with Databricks & GCPLocation- 100 % RemoteDuration: 6 Months ContractImmediate JoinerExperience Level: 10+ yrs Must-Have Skills:- Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark.- Expertise in SQL and advanced query optimization.- Proficiency in Python for data engineering and...

  • Data Engineer with Databricks

    2 weeks ago

    bangalore, India iitjobs, Inc. Full time

    Greetings!!! Role:- Data Engineer with Databricks & GCP Location- 100 % Remote Duration: 6 Months Contract Immediate Joiner Experience Level: 10+ yrs Must-Have Skills: - Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark. - Expertise in SQL and advanced query optimization. - Proficiency in Python for data engineering...

  • Databricks Engineer

    7 days ago

    bangalore, India DataE2E Technologies Full time

    Job Title: Databricks Engineer (Remote)Location: 100 % RemoteJob Type: Full-TimeShift timings: 3 pm - 11 pm ISTAbout the Role:We are looking for an experienced Databricks Engineer with a strong background in data engineering and business intelligence to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on...