Senior Data Engineer

1 month ago

Hyderabad, Telangana, India PepsiCo Full time
Job Summary

As a key member of the data & analytics team at PepsiCo, you will be responsible for developing and overseeing the company's data product build & operations. You will drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be an empowered member of a team of MLOps engineers who build MLOps pipelines to deploy and orchestrate AI/ML Models to support the ML lifecycle. As a member of the MLOps team, you will lead the development of very large and complex MLOps pipelines into cloud environments directly impacting the design, architecture, and implementation of PepsiCo's flagship data products around finance. You will work closely with process owners, product owners, and business users. You'll be working in a hybrid environment with in-house, on-premises data sources as well as cloud and remote systems.

Responsibilities

  • Design and implement scalable solutions for data scientists to deploy their ML models and monitor their health on a multi-tenant platform.
  • Identify and develop MLOps features-Azure DevOps Pipelines, Azure Data Factory, Synapse.
  • Create tools, processes, or workflows that enable our Data Scientists to operate more efficiently.
  • Participate in the entire Machine Learning Lifecycle, deploying code to various environments, CI/CD integration, performance monitoring, and change management.
  • Build pipelines, feedback loops, ML workflows, and APIs.
  • Azure certifications/knowledge will be preferred.
  • Responsible for the sustainability of already live pipelines in production environments.


Qualifications

  • Bachelor's degree in computer science, MIS, Business Management, or related field.
  • 3+ years of cloud experience (Azure, AWS, GCP, etc.) - Preferably Azure.
  • Proficiency with Python & PySpark programming in Databricks Environment.
  • Comfortable working with complex SQL.
  • Experience with ML model serving technologies like Kubeflow Serving, MLFlow, etc.
  • Experience with common data science frameworks (Pandas, NumPy, Scikit-learn, TensorFlow).
  • Experience in creating Azure Data Factory & Azure DevOps Pipelines.
  • Experience in supporting QA and production deployments and developing end-to-end CI/CD Pipelines.
  • Experience of Azure infrastructure and platform in context to AI/ML.
  • Well-versed with automations and deployments using cutting-edge Azure technologies.
  • Good written and verbal communication skills along with collaboration and listening skills.
  • Nice to have experience related to Big Data.


Mandatory 'Non-Technical' Skills

  • Excellent remote collaboration skills.
  • Experience working in a matrix organization with diverse priorities.
  • Enthusiast for learning functional knowledge specific to finance business.
  • Ability to work with virtual teams (remote work locations); within a team of technical resources (employees and contractors) based in multiple global locations.
  • Participate in technical discussions, driving clarity of complex issues/requirements to build robust solutions.
  • Strong communication skills to meet with delivery teams and business-facing teams, understand sometimes ambiguous, needs, and translate to clear, aligned requirements.

  • Senior Data Engineer for Digital Transformation

    6 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Description:We are seeking a highly skilled Senior Data Engineer to join our team in Remote, Telangana (IN). This is a full-time position with 40 hours per week.About the Role:The successful candidate will design, develop, and maintain scalable data pipelines in the Python ecosystem. They will also participate in regular team ceremonies and contribute to...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India The Modern Data Company Full time

    Job Description :The Senior Data Engineer will provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...

  • Big Data Engineer, Data Modeling Expert

    1 month ago

    Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...

  • Digital Engineering Senior Software Engineer

    1 month ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Senior Data Migration ConsultantWe are seeking an experienced Senior Data Migration Consultant to join our team at NTT DATA Services. As a Senior Data Migration Consultant, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities:12 years of experience in SAP Data...

  • Senior Digital Engineering Expert

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID: 295140 NTT DATA is seeking a talented individual to fill the role of Digital Engineering Senior Engineer. We strive to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, we encourage you to apply.We are currently seeking...

  • Innovative Big Data Solutions Engineer

    11 hours ago

    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Solutions Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data products components based on requirements with possible technical solutions.You will work closely with Data Scientists, Data Engineers,...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India Experian Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines using Spark and...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India DBS Bank Full time

    Job SummaryDBS Bank is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key ResponsibilitiesDesign and develop data pipelines using Python, Hadoop, Spark, and Hive.Develop and maintain data warehouses and data...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India 451 Discovery Comm. India Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team at 451 Discovery Comm. India. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures that support our business operations.Key Responsibilities:Analyze complex data sets to identify trends and...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking an experienced Senior Data Engineer to join our team in India. As a Senior Data Engineer, you will play a key role in designing and implementing modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, and Data Bricks.The ideal candidate should have at least 5 years of...

  • Senior Data Architect

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job OverviewMake a lasting impact with NTT DATAAs a trusted global innovator of business and technology services, we are renowned for our technical excellence and leading innovations.Your role at NTT DATAThe Principal Cross Technology Engineer is a highly skilled engineering role, responsible for creating and maintaining a cross technology managed service to...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Bristol Myers Squibb Full time

    About the RoleBristol Myers Squibb is seeking a talented Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining reliable data transformational solutions to drive critical business impacts.About the TeamYou will be part of a dynamic team that is passionate about using data to drive...

  • Senior Software Engineer

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    We are seeking a skilled Senior Software Engineer to join our team at {company}. The ideal candidate will possess a deep understanding of software development principles and be proficient in a variety of programming languages.

  • Big Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Senior Software Engineering Lead

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    About the JobWe are seeking a Senior Software Engineering Lead to join our team in Hyderabad, Telangana (IN), India.Job Summary:As a Senior Software Engineering Lead, you will be responsible for designing, implementing, and maintaining Java-based applications that can handle high volumes and low latency. You will work closely with cross-functional teams to...

  • Senior Data Engineer

    1 month ago

    Hyderabad, Telangana, India Evnek Technologies Pvt Ltd Full time

    Job Title: Senior Data EngineerJob Description:As a Senior Data Engineer at Evnek Technologies Pvt Ltd, you will be responsible for designing and implementing large-scale data systems that can handle high volumes of data.You will work closely with the development team to ensure that the data systems are scalable, secure, and meet the business...

  • Senior Software Engineer

    4 weeks ago

    Hyderabad, Telangana, India data Full time

    About the Job:We are seeking a highly skilled Senior Software Engineer to join our team at {company}. The ideal candidate will have expertise in backend development using Python and Java.Key Responsibilities:Develop high-quality code for our backend systemsCollaborate with cross-functional teams to design and implement new featuresEnsure the scalability and...

  • Senior Digital Engineering Expert

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    About the RoleWe are seeking a Digital Engineering Senior Engineer to join our team in Hyderabad, Telangana (IN-TG) and India (IN).Key ResponsibilitiesConduct data analysis using Python and leverage AI models for business value.Develop and implement AI models leveraging Langchain, LlamaIndex, and Azure OpenAI Services.Utilize Generative AI models and Natural...

  • Senior Cybersecurity Engineer

    1 month ago

    Hyderabad, Telangana, India NTT DATA Full time

    About the RoleThis is an exciting opportunity to join NTT DATA as a Senior Engineer in our Security Managed Services team. As a key member of our team, you will be responsible for providing a managed service to clients to ensure that their Security Infrastructures and systems remain operational.Key ResponsibilitiesProactively monitor the work queues and...