▷ 15h Left Lead Data Engineer

6 days ago

Bengaluru, India Ecolab Global Services Full time

Job Description Lead Databricks Data Engineer - Ecolab is looking for a Data Engineer to be part of a dynamic team that's at the forefront of technological innovation. We're leveraging cutting-edge AI to create novel solutions that optimize operations for our clients, particularly within the restaurant industry. Our work is transforming how restaurants operate, making them more efficient and sustainable. - As a key player in our new division, you'll have the unique opportunity to help shape its culture and direction. Your contributions will directly impact the success of our innovative projects and help define the future of our product offerings.Additionally, you will experience the best of both worlds with this team at Ecolab: the agility and creativity of a startup paired with the stability and resources of a global leader. Our collaborative environment fosters innovation while providing the support and security you need to thrive. Responsibilities - Design, develop, and maintain scalable and robust data pipelines on Databricks (Spark SQL, PySpark, Delta Lake). - Collaborate with data scientists and analysts to understand data requirements and deliver solutions. - Optimize and troubleshoot existing data pipelines for performance and reliability. - Ensure data quality and integrity across various data sources. - Implement data security and compliance best practices. - Monitor data pipeline performance, implement data quality checks, and conduct necessary maintenance and updates. - Document data pipeline processes and technical specifications. - Implement robust pipeline orchestration using tools like Databricks Workflows, dbt, or similar. - Generate and maintain data quality reports and dashboards. - Implement Infrastructure as Code (IaC) principles for managing Databricks infrastructure. Minimum Qualifications - Bachelors degree and 8 years work experience; or no degree and 12 years combined education and equivalent work experience. - 3 years of experience (work or educational) with a data engineering focus. - Proven experience in Databricks (Delta Lake, Workflows, Asset Bundles). - Proven experience in distributed data processing technologies (Spark SQL, PySpark). - Strong knowledge in designing and developing ETL pipelines. - Experience with data quality monitoring and reporting. - Experience working in a collaborative environment with data scientists and software engineers. Preferred Qualifications - Masters degree (MS) in Computer Science or related engineering field. - Proficiency in Databricks (Delta Lake, Workflows, Asset Bundles). - Proficiency in distributed data processing technologies (Spark SQL, PySpark). - Experience with pipeline orchestration tools (Databricks Workflows, dbt, etc.). - Experience with data visualization tools (e.g., Tableau, Power BI). - Working experience with machine learning platforms and tools. - Experience with real-time data streaming technologies (e.g., Kafka, Kinesis).

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). - 6+ years of experience in Data...

  • ▷ 15h Left! Data Engineer-Technical Lead

    6 days ago

    Bengaluru, India Sigmoid Full time

    Kindly find the Job Description Below. Job Title:Technical Lead-Azure Data Engineer Location: Bangalore Years of Experience: 10+ years of experience Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Technical Lead- Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Test Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Test Data Engineer - SDET (Data Foundations)_ to join our team in Bangalore, Karnātaka...

  • Test Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Test Data Engineer - SDET (Data Foundations)_ to join our team in Bangalore, Karnātaka (IN-KA),...

  • ▷ 15h Left! Informatica Developer

    2 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Informatica Developer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Informatica Developer Role Overview...

  • ▷ 15h Left! Data Engineer

    4 weeks ago

    Bengaluru, India Insight Global Full time

    Job Description JOB DESCRIPTION Insight Global is seeking a junior Data Engineer to join a large retail client remotely based in India. The Junior Data Engineer will support the identification and implementation of complex data, monitor and troubleshoot data engineering incidents and more. The Junior-level Data Engineer is expected to have 3+ years of...

  • Data & AI Consultant [15h Left]

    6 days ago

    Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion it's a place where you can grow, belong and thrive. Your day at NTT DATA...

  • Offshore Data Engineer Tester

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Offshore Data Engineer Tester (Lead) to join our team in Bangalore, Karnātaka (IN-KA), India...