Databricks Data Engineer Lead – Sustainability Project

2 weeks ago

bangalore, India Blue Cloud Softech Solutions Limited Full time

Job Summary:BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative. The engineer will be responsible for building data pipelines and models to support product-level carbon footprint analysis. This role involves integrating structured engineering, manufacturing, and supplier data into a unified model using Databricks on AWS.Key Responsibilities:• Develop and optimize ETL/ELT pipelines on Databricks using PySpark and SQL to support carbon footprint analytics.• Build data models that combine engineering (EBOM), manufacturing (MBOM), supplier, and factory operations data to generate emissions metrics.• Integrate and transform data from:• MBOM from SAP, including multilevel BOM explosion logic• EBOM from Oracle-based systems (no explosion required)• Supplier environmental data (e.g., material-level emissions)• Factory data (e.g., energy consumption, material usage)• Collaborate with sustainability analysts, engineering teams, and supply chain stakeholders to translate carbon calculation logic into data transformations.• Ensure high data quality, lineage, and governance using Delta Lake, Unity Catalog, and standard best practices.• Leverage AWS services such as S3, Glue, and Athena for orchestration and storage.• Document data logic and workflows for traceability and compliance with ESG standards.Technical Requirements:• Hands-on experience with Databricks (Delta Lake, Unity Catalog, Jobs, Workflows)• Strong skills in PySpark and SQL• Experience with SAP MBOM structures, especially multilevel BOM explosion• Understanding of Oracle-based EBOM systems and ability to integrate structured data• Familiarity with AWS data ecosystem (S3, Glue, Lambda, Athena)• Strong knowledge of data modeling, pipeline optimization, and performance tuningPreferred Qualifications:• Experience in carbon accounting, lifecycle analysis, or sustainability-focused data projects• Understanding of manufacturing data and supply chain operations• Exposure to SAP ECC/S/4HANA and Oracle-based PLM or engineering systems• Experience with version control, CI/CD (e.g., Git, Databricks Repos)

  • Databricks Data Engineer Lead

    10 hours ago

    bangalore, India Blue Cloud Softech Solutions Limited Full time

    Job Summary: BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative. The engineer will be responsible for building data pipelines and models to support product-level carbon footprint analysis. This role involves integrating structured engineering, manufacturing, and supplier data into a unified model using...

  • Lead Data Engineer

    4 weeks ago

    bangalore, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Databricks Lead

    7 hours ago

    bangalore, India Mastech Digital Full time

    Job Title: Databricks Lead Location: Chennai/Hyderabad/BangaloreExperience: 8-10 years of overall experience and 5+ years of hands-on leadership in data engineering projectsBudget: Open to discussNotice Period: Immediate joiner/ Serving notice with less than 60 days/Notice is less than 60 daysAbout the RoleWe are looking for a highly skilled Databricks Lead...

  • Senior Databricks Data Engineer

    8 hours ago

    bangalore, India Squash Apps Full time

    Company DescriptionSquash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies, including MEAN, MERN, MEVN stack, Java stack, SQL/NoSQL, Elastic Search, Redis, and hybrid mobile applications. With innovative projects...

  • Sr. Data Engineer

    4 weeks ago

    bangalore, India xponent.ai Full time

    We are an Australian Data and AI company and are expanding our Databricks Capability in India and are seeking a Senior Databricks Data Engineer to build scalable, production-grade data platforms that enable AI and advanced analytics for our global clients. We are open, transparent, no-nonsense, innovative problem solvers and eternal learners as a team where...

  • Azure Databricks Engineer

    5 days ago

    Bangalore, India Jobted IN C2 Full time

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of...

  • Databricks - Manager

    1 week ago

    bangalore, India BSR & Co Full time

    DescriptionJob Title: Databricks ManagerLocation: BangaloreExperience: 10+ Years10+ years of professional experience in data engineering, with a focus on Databricks.Programming expertise on python, SQL, SparkGood experience on databricks - dealing with data pipelines, medallion architecture, Lakehouse, delta tables, time travel, unity catalog, processing...

  • Databricks Architect || Bangalore and Chennai

    7 days ago

    bangalore, India HCLTech Full time

    HCLTech is hiring Databricks Architect for Bangalore and Chennai location.Job Title : Databricks ArchitectOverall Experience: 10+ yrs (5+yrs in Data Architecture)Location : Bangalore/ChennaiNotice Period: Immediate/30 daysINTRODUCTION TO THE ORGANIZATIONHCLTech is a leading multinational technology company renowned for its innovative solutions and industry...

  • Databricks Architect || Chennai and Bangalore

    7 days ago

    bangalore, India HCLTech Full time

    HCLTech is hiring Databricks Architect for Bangalore and Chennai location.Job Title : Databricks Architect Location : Bangalore/ChennaiNotice Period: Immediate/30 daysOverall Experience: 10+ yrs (5+yrs in Data Architecture) INTRODUCTION TO THE ORGANIZATION HCLTech is a leading multinational technology company renowned for its innovative solutions and...

  • Databricks Architect || Bangalore and Chennai

    4 weeks ago

    bangalore, India HCLTech Full time

    HCLTech is hiring Databricks Architect for Bangalore and Chennai location. Job Title : Databricks Architect Overall Experience: 10+ yrs (5+yrs in Data Architecture) Location : Bangalore/Chennai Notice Period : Immediate/30 days INTRODUCTION TO THE ORGANIZATION HCLTech is a leading multinational technology company renowned for its innovative solutions and...