Data Engineering Lead for Enterprise Data Operations

7 days ago

Hyderabad, Telangana, India PepsiCo Full time
Overview of PepsiCo

PepsiCo is a leading global food and beverage company, with a portfolio of diverse and beloved brands. Our company has a strong presence in over 200 countries and territories, with a global workforce of over 250,000 employees.

We operate in an environment of rapid change, driven by technological advancements such as big-data and digital technologies. These changes are unlocking new business capabilities and innovations in areas like e-commerce, mobile experiences, and IoT.

Enterprise Data Operations Team

The Enterprise Data Operations team is responsible for developing quality data collection processes, maintaining the integrity of our data foundations, and enabling business leaders and data scientists to access the data they need for decision-making and innovation.

Key Responsibilities
  • Maintain a predictable and transparent global operating rhythm that ensures always-on access to high-quality data for stakeholders across the company.
  • Responsible for day-to-day data collection, transportation, maintenance/curation, and access to the PepsiCo corporate data asset.
  • Work cross-functionally across the enterprise to centralize data and standardize it for use by business, data science, or other stakeholders.
  • Increase awareness about available data and democratize access to it across the company.
About This Role

We are seeking a highly skilled Data Engineer to join our team and lead the development of our data products. As a key member of the data engineering team, you will be responsible for developing and overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business.

You will work closely with process owners, product owners, and business users to design, architect, and implement large-scale data applications into public cloud environments directly impacting the design, architecture, and implementation of PepsiCo's flagship data products around topics like revenue management, supply chain, manufacturing, and logistics.

Accountabilities
  • Be a founding member of the data engineering team and help attract talent to the team through networking and representing PepsiCo at conferences and events.
  • Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability, and ongoing metrics.
  • Ensure that we build high-quality software by reviewing peer code check-ins.
  • Define best practices for product development, engineering, and coding as part of a world-class engineering team.
  • Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms.
  • Lead feature development in collaboration with other engineers; validate requirements/stories, assess current system capabilities, and decompose feature requirements into engineering tasks.
  • Focus on delivering high-quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with other engineers.
  • Develop software in short iterations to quickly add business value.
  • Introduce new tools/practices to improve data and code quality; this includes researching/sourcing 3rd-party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers.
  • Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues.
Qualifications
  • 3+ years of experience in SQL optimization and performance tuning.
  • Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines.
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
  • Experience with data profiling and data quality tools like Apache Griffin, Deequ, or Great Expectations.
  • Current skills in following technologies: Python Orchestration platforms: Airflow, Luigi, Databricks, or similar Relational databases: Postgres, MySQL, or equivalents MPP data systems: Snowflake, Redshift, Synapse, or similar Cloud platforms: AWS, Azure, or similar Version control (Git, GitHub) and familiarity with deployment, CI/CD tools.
  • Fluent with Agile processes and tools such as Jira or Pivotal Tracker.
  • Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes is a plus.
  • Understanding of metadata management, data lineage, and data glossaries is a plus.
Education
  • BE/B.Tech in Computer Science, Math, Physics, or other technical fields.
Salary Information

The estimated salary range for this role is $150,000 - $200,000 per year, depending on qualifications and experience.

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...

  • Data Analyst Position

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    A Career Defining Role in Data IntelligenceAs a Data Analyst, you will play a pivotal role in helping us uncover hidden insights and trends within our vast dataset. Your expertise will be instrumental in ensuring the accuracy and quality of our data, enabling us to make informed decisions that drive business growth.ResponsibilitiesTake ownership of data.ai's...

  • Senior Data Architect

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job OverviewMake a lasting impact with NTT DATAAs a trusted global innovator of business and technology services, we are renowned for our technical excellence and leading innovations.Your role at NTT DATAThe Principal Cross Technology Engineer is a highly skilled engineering role, responsible for creating and maintaining a cross technology managed service to...

  • Innovative Big Data Solutions Engineer

    1 day ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...

  • Data Intelligence Specialist

    2 days ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Intelligence Specialist to join our engineering team in Hyderabad, India.The ideal candidate will have a strong passion for data analysis and quality monitoring, with a deep understanding of complex datasets and statistical measurements.Key ResponsibilitiesTake full ownership of data.ai core intelligence...

  • Big Data Systems Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...

  • Data Modeling Expert

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    What drives innovation in data-driven products?We are looking for an experienced data engineer to join our team and contribute to the development of innovative analytics and data products. As a big data engineer, you will be part of a collaborative team that uses agile methodologies and open-source technologies to build cutting-edge data processing programs....

  • Enterprise Data Systems Architect

    5 days ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    NNT DATA Services is seeking an exceptional SAP Data Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).As a key member of our data engineering team, you will play a vital role in designing and implementing scalable data systems and pipelines. Your expertise in SAP ECC 6.0 on HANA database or SAP S/4HANA will enable us to deliver...

  • Advanced Data Analytics Engineer with Cloud Expertise

    7 days ago

    Hyderabad, Telangana, India data Full time

    Unlock the Power of Big DataWe are seeking an experienced Advanced Data Analytics Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will play a crucial role in designing and implementing innovative data products using agile methodologies and open-source technologies.About the RoleThis is an exciting opportunity to...

  • Senior Data Engineer for Digital Transformation

    7 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team in Remote, Telangana (IN). This is a full-time position with 40 hours per week.About the Role:The successful candidate will design, develop, and maintain scalable data pipelines in the Python ecosystem. They will also participate in regular team ceremonies and contribute to...

  • Data Engineer for Enterprise Data Pipelines

    1 month ago

    Hyderabad, Telangana, India PRONTO CONSULTING SERVICES Full time

    Job Title: Data Engineer for Enterprise Data PipelinesAt Pronto Consulting Services, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines that support our business operations. Your expertise in data engineering will ensure the seamless...

  • Data Scientist

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking a highly skilled Data Analyst to join our engineering team at data.ai. As a Data Analyst, you will play a vital role in delivering high-quality app market data to app professionals.The successful candidate will be responsible for data profiling, data cleansing, data quality monitoring, and root cause analysis. You will work...

  • Data Engineering Specialist

    4 weeks ago

    Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Data Engineering SpecialistStatistics & Data Corporation (SDC), a specialized contract research organization (CRO), is seeking a skilled Data Engineering Specialist to join our team. With a strong focus on clinical trials, we provide top-tier services to pharmaceutical, biologic, and medical device/diagnostic companies.Job SummaryAs a Data Engineering...

  • Data Migration Technical Team Lead

    1 month ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data Migration Technical Team LeadWe are seeking a highly experienced Data Migration Technical Team Lead to join our team in Hyderabad, Telangana, India. As a key member of our team, you will be responsible for leading cross-functional teams to understand complex landscapes and processes, develop requirements, map data, and document conversion...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Enterprise Data Operations Manager

    4 weeks ago

    Hyderabad, Telangana, India PepsiCo Full time

    About PepsiCo's Data Management and Operations TeamPepsiCo operates in an environment characterized by rapid change, driven by big-data and digital technologies. These technologies are unlocking new business capabilities and innovations in areas such as e-commerce, mobile experiences, and IoT. To succeed, PepsiCo relies on enterprise data foundations built...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India The Modern Data Company Full time

    Job Description :The Senior Data Engineer will provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID: 287684 NTT DATA Services is seeking a highly skilled Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Key Responsibilities:Providing cloud administration, maintenance, and troubleshooting support.Developing and implementing cloud infrastructure solutions.Collaborating with cross-functional...

  • Data Insights Analyst

    3 weeks ago

    Hyderabad, Telangana, India data Full time

    Unlock the Power of DataAs a Data Analyst and Quality Assurance Expert at data.ai, you will play a critical role in ensuring the accuracy and reliability of our data insights.Key Responsibilities:Own the data monitoring activities and develop automated and reusable quality monitoring and improvement solutionsWork at the front line to troubleshoot quickly and...

  • Data Architect and Engineer for Enterprise Information Management

    7 days ago

    Hyderabad, Telangana, India S P A Enterprise Info Services (India) Pvt Ltd Full time

    Job OverviewWe are seeking a highly skilled Data Architect and Engineer to lead our enterprise information management efforts. As part of our team, you will be responsible for designing, implementing, and documenting data architecture and modeling solutions that support business intelligence, machine learning, data science, and other business interests.Key...