Associate Manager Data Engineer

3 weeks ago


gurugram, India PepsiCo Full time
Overview

PepsiCo operates in an environment undergoing immense and rapid change. Big-data and digital technologies are driving business transformation that is unlocking new capabilities and business innovations in areas like eCommerce, mobile experiences and IoT. The key to winning in these areas is being able to leverage enterprise data foundations built on PepsiCo’s global business scale to enable business insights, advanced analytics and new product development. PepsiCo’s Enterprise Data Operations (EDO) team is tasked with the responsibility of developing quality data collection processes, maintaining the integrity of our data foundations and enabling business leaders and data scientists across the company to have rapid access to the data they need for decision-making and innovation.

What PepsiCo Enterprise Data Operations (EDO) does:

Maintain a predictable, transparent, global operating rhythm that ensures always-on access to high-quality data for stakeholders across the company Responsible for day-to-day data collection, transportation, maintenance/curation and access to the PepsiCo corporate data asset Work cross-functionally across the enterprise to centralize data and standardize it for use by business, data science or other stakeholders Increase awareness about available data and democratize access to it across the company

Job Description

As a member of the data engineering team, you will be the key technical expert developing and overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be an empowered member of a team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting the design, architecture, and implementation of PepsiCo's flagship data products around topics like revenue management, supply chain, manufacturing, and logistics. You will work closely with process owners, product owners and business users. You'll be working in a hybrid environment with in-house, on-premise data sources as well as cloud and remote systems.

Important Disclaimer :

The candidate is required to work for 4 weekends in a quarter (you may be required to work only on Saturday or Sunday or Sat & Sun) and basis that you'll get compensatory off. Please note that this role will be based ONLY in India. The role does not involve any movement to other PepsiCo offices outside India in future Responsibilities Active contributor to code development in projects and services. Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products. Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance. Responsible for implementing best practices around systems integration, security, performance and data management. Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape. Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions. Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners. Develop and optimize procedures to “productionalize” data science models. Define and manage SLA’s for data products and processes running in production. Support large-scale experimentation done by data scientists. Prototype new approaches and build solutions at scale. Research in state-of-the-art methodologies. Create documentation for learnings and knowledge transfer. Create and audit reusable packages or libraries. Qualifications 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. 4+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.). 2+ years in cloud data engineering experience in Azure. Fluent with Azure cloud services. Azure Certification is a plus. Experience with integration of multi cloud services with on-premises technologies. Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines. Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations. Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake. Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes. Experience with version control systems like Github and deployment & CI tools. Experience with Azure Data Factory, Azure Databricks and Azure Machine learning tools. Experience with Statistical/ML techniques is a plus. Experience with building solutions in the retail or in the supply chain space is a plus Understanding of metadata management, data lineage, and data glossaries is a plus. Working knowledge of agile development, including DevOps and DataOps concepts. Familiarity with business intelligence tools (such as PowerBI). 

Education

BA/BS in Computer Science, Math, Physics, or other technical fields.

Skills, Abilities, Knowledge

Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management. Proven track record of leading, mentoring data teams. Strong change manager. Comfortable with change, especially that which arises through company growth. Ability to understand and translate business requirements into data and technical requirements. High degree of organization and ability to manage multiple, competing projects and priorities simultaneously. Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment. Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs. Foster a team culture of accountability, communication, and self-management. Proactively drives impact and engagement while bringing others along. Consistently attain/exceed individual and team goals Ability to lead others without direct authority in a matrixed environment.

Competencies

Highly influential and having the ability to educate challenging stakeholders on the role of data and its purpose in the business. Understands both the engineering and business side of the Data Products released.  Places the user in the center of decision making.  Teams up and collaborates for speed, agility, and innovation.  Experience with and embraces agile methodologies.  Strong negotiation and decision-making skill.  Experience managing and working with globally distributed teams.
  • Data Engineer

    1 month ago


    Gurugram, India Acuity Knowledge Partners Full time

    Opportunity- Data Engineer (Associate/ Senior Associate)Location- Gurugram (Hybrid)"Immediate joiners are highly preferred!" Key Responsibilities:Partner with data strategy and sourcing team on data requirements to design data pipelines and delivery structures.Engage with vendors and technical teams to systematically ingest, evaluate, and create valuable...

  • Associate Data Engineer

    46 minutes ago


    gurugram, India United Airlines Full time

    Description Job overview and responsibilities As an Associate Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow of data and enabling efficient data analysis and reporting. You will work closely with our data scientists, analysts, and software engineers to implement data...


  • Gurugram, India United Airlines Full time

    Description Job overview and responsibilities As an Associate Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring the smooth flow of data and enabling efficient data analysis and reporting. You will work closely with our data scientists, analysts, and software engineers to implement data...


  • Gurugram, India PepsiCo Full time

    Overview PepsiCo operates in an environment undergoing immense and rapid change. Big-data and digital technologies are driving business transformation that is unlocking new capabilities and business innovations in areas like eCommerce, mobile experiences and IoT. The key to winning in these areas is being able to leverage enterprise data foundations built...


  • Gurugram, India PepsiCo Full time

    Overview PepsiCo operates in an environment undergoing immense and rapid change. Big-data and digital technologies are driving business transformation that is unlocking new capabilities and business innovations in areas like eCommerce, mobile experiences and IoT. The key to winning in these areas is being able to leverage enterprise data foundations built...


  • Gurugram, Haryana, India NTT DATA Full time

    The Client Management Services organization supports our NTT DATA Account Leaders in Contract Management, Account Governance and Business Process Compliance activities to enable timely order-to-cash process and effective coordination between Sales, Forecasting, ERP and Resourcing actions. The primary objective of this group is enabling Client Managers to...

  • One MobiKwik Systems

    2 weeks ago


    Gurugram, India One Mobikwik Systems Limited Full time

    Job Title: Associate Director, Data EngineerAt MobiKwik, we are revolutionizing the way people manage their finances, make payments, and engage with digital services. Our mission is to empower individuals and businesses with innovative financial solutions that enhance convenience, security, and efficiency in their daily lives. As a leading fintech company,...


  • gurugram, India TaskUs Full time

    About TaskUs: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming...


  • gurugram, India TaskUs Full time

    About TaskUs: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, TaskUs serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming...


  • Gurugram, India Publicis Groupe Full time

    Job Description Your responsibilities as a Data Engineering Associate Director -  As a Data Engineer, you will develop and deliver solutions that enable our agency teams to win in a very competitive marketplace. The right candidate will be somebody who is motivated to get it done, loves to continually learn and builds software utilizing modern...


  • Gurugram, India Publicis Groupe Full time

    Job Description Your responsibilities as a Data Engineering Associate Director -  As a Data Engineer, you will develop and deliver solutions that enable our agency teams to win in a very competitive marketplace. The right candidate will be somebody who is motivated to get it done, loves to continually learn and builds software utilizing modern...


  • gurugram, India Publicis Groupe Full time

    Job Description Your responsibilities as a Data Engineering Associate Director -  As a Data Engineer, you will develop and deliver solutions that enable our agency teams to win in a very competitive marketplace. The right candidate will be somebody who is motivated to get it done, loves to continually learn and builds software utilizing...


  • Gurugram, India NTT DATA Full time

    Job Description The CompanyNTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan. We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce...


  • gurugram, India NTT DATA Full time

    Job Description The Company NTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan. We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce...


  • Gurugram, Haryana, India NTT DATA Full time

    **The Company** NTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan. We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce costs with less...


  • Gurugram, Haryana, India NTT DATA Full time

    **The Company** NTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan. We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce costs with less...


  • Gurugram, India NTT DATA Services Full time

    The CompanyNTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan.   We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce costs with less...


  • Gurugram, India NTT DATA Services Full time

    The CompanyNTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan.   We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce costs with less...


  • gurugram, India NTT DATA Services Full time

    The Company NTT DATA Services is a top 10 global services company and part of the NTT Group, a Fortune 29 telecommunications and services company based in Japan.   We operate with 60,000 professionals in 36 countries. Every day around the world we help clients explore new ways to respond to market dynamics with flexibility and speed, reduce costs with less...


  • Gurugram, India Metyis Full time

    What we offer   Interact with C-level at our clients on regular basis to drive their business towards impactful change Lead your team in creating new business solutions Seize opportunities at the client and at Metyis in our entrepreneurial environment Become part of a fast-growing international and diverse team What you will do Metyis is...