Data Platform Engineering Lead

1 month ago

Gurgaon, Haryana, India NatWest Group Full time

Join us as a Data Platform Engineering LeadThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank through developing innovative data driven platform and framework solutions, inspiring to be commercially successful through insight, and keeping our customers' and the bank's data safe and secureParticipating actively in the data platform engineering community, you'll deliver opportunities to support our strategic direction while building your network across the bank

What you'll do

We'll look to you to demonstrate technical and people leadership to drive value for the customer through platform engineering, toolkit adoption, cloud integration, sourcing and data transformation frameworks. You'll be working closely with core technology and architecture teams to deliver strategic data solutions, while driving Agile and DevOps adoption in the delivery of data engineering, leading a team of platform engineers.

We'll also expect you to be:

Ensuring deployment and management of distributed data platformsProduct licensing , adoption and integration Owning and Delivering the automation of data engineering pipelines Developing frameworks to enable bank's data structures and metrics, advocating change where needed for product developmentEducating and embedding new tools and techniques into the business through role modelling, training and experiment design oversightDelivering platform roadmap and engineering strategies to build a scalable data architecture and customer feature rich dataset for data scientistsDeveloping solutions for streaming data ingestion and transformations in line with streaming strategy

The skills you'll need

We're recruiting for multiple roles across a range to levels, up to and including experienced Managers.

To be successful in this role, you'll need to be an expert level programmer and data engineer with a qualification in Computer Science or Software Engineering. You'll also need a strong understanding of data usage and dependencies with wider teams and the end customer, as well as extensive experience in extracting value and features from large scale data.

You'll need experience in deploying and managing distributed data/ETL pipelines (batch mode and real time streaming) hosted on Hadoop, Spark, Kafka, Informatica and MongoDB. You will also have experience of managing data engineering tooling/orchestration such as Streamsets and Informatica PWC/BDM/IICS on premise/cloud infrastructure. You will also demonstrate:

Experience of developing real time data streaming pipelines using Change Data Capture (CDC), Kafka and Streamsets/NiFi/Flume/FlinkExperience with Change Data Capture tooling such as IBM Infosphere, Oracle Golden Gate, Attunity, DebeziumExperience of ETL technical design, automated data quality testing, QA and documentation, data warehousing, data modelling and data wranglingExpertise in Unix and DevOps automation tools like Terraform and Puppet and experience in deploying applications to at least one of the major public cloud provider such AWS, GCP or AzureExtensive experience using RDMS and one of the no-sql database such as MongoDB, ETL pipelines, Python, Java APIs using spring boot and writing complex SQLsA good understanding of cloud warehouse such as SnowflakeA good understanding of modern code development practicesGood critical thinking and proven problem solving abilities

  • Data Platform

    1 week ago

    Gurgaon, Haryana, India Stem, Inc. Full time

    Stem's culture embodies diversity & inclusion beyond the traditional facets of gender, ethnicity, age, disabilities, and sexual orientation to include experience, personality, communication, workstyles, and more. At our core, Stem is at the momentous intersection of clean energy and software technology where diverse ideas, experiences, and professional...

  • Data Platform

    1 week ago

    Gurgaon, Haryana, India AlsoEnergy India Private Limited Full time

    Stem provides clean energy solutions and services designed to maximize the economic, environmental, and resiliency value of energy assets and portfolios. Stem's leading AI-driven enterprise software platform, Athena, enables organizations to deploy and unlock value from clean energy assets at scale. Powerful applications, including AlsoEnergy's PowerTrack,...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies Write and tune complex Java, MapReduce, Pig and Hive jobs Adapt quickly to change in requirements...

  • MLOps Platform Engineer

    1 week ago

    Gurgaon, Haryana, India Amantya Technologies Full time

    Title : MLOps Platform EngineerExperience : 7yrs-10yrsLocation : GurgaonAbout the Role :We are seeking a highly skilled and motivated MLOps Platform Engineer to join our team. The ideal candidate will be responsible for developing, maintaining, and enhancing our MLOps platform, which integrates data ingestion, preprocessing, workflow orchestration, and...

  • MLOps Platform Engineer

    1 week ago

    Gurgaon, Haryana, India Amantya Technologies Full time

    About the Role : We are seeking a highly skilled and motivated MLOps Platform Engineer to join our team. The ideal candidate will be responsible for developing, maintaining, and enhancing our MLOps platform, which integrates data ingestion, preprocessing, workflow orchestration, and machine learning pipelines. This role requires a strong background in...

  • Dataiku Platform Engineer

    1 week ago

    Gurgaon, Haryana, India Virtusa Full time

    Dataiku Platform Engineer - CREQ184997 Description Bachelor's degree in Computer Science, Engineering, or related field. Proven experience as a Data Engineer, Platform Engineer, or similar role. Strong proficiency with Dataiku platform administration, configuration, and optimization. Experience designing and implementing data pipelines, workflows, and...

  • Lead Data Engineer

    2 months ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead Data Engineer

    2 months ago

    Gurgaon, Haryana, India United Airlines Full time

    DescriptionUnited's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people....

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    DescriptionUnited's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people....

  • Azure Data Platform Engineer

    1 week ago

    Gurgaon, Haryana, India NCR Corporation Full time

    About NCR VOYIX NCR VOYIX Corporation (NYSE: VYX) is a leading global provider of digital commerce solutions for the retail, restaurant and banking industries. NCR VOYIX is headquartered in Atlanta, Georgia, with approximately 16,000 employees in 35 countries across the globe. For nearly 140 years, we have been the global leader in consumer transaction...

  • Platform Engineer

    6 days ago

    Gurgaon, Haryana, India adidas Full time

    Date:August 2022 Page 1 of 4 Platform Engineer Area: IT - Platform Engineering Subsidiary/Country: Germany Location: Herzogenaurach GSMS Grade: M4 Number of Personnel Managed: see most recent Org Chart Cost Center/Budget and/or Revenue Responsibility: tbdTECH Job Family: Platform Engineering Purpose & Overall Relevance for the Organization: The role builds,...

  • Cloud Platform Lead

    1 week ago

    Gurgaon, Haryana, India Virtusa Full time

    Cloud Platform Lead - CREQ186463 Description Platform Engineer Job Responsibilities Work with the platform team to architect solutions using modern management tools likeMECM and Intune Build, deploy and support Autopilot as the default device provisioning and imaging solution for the enterprise Automate work processes using advanced scripting techniques...

  • Lead- Data Engineering

    1 week ago

    Gurgaon, Haryana, India FNP Full time

    Job Title: Lead- Data Engineering Department: CET Location: Corporate Office, Gurgaon Exp Range: 8 to 10 Years Educational Qualification: Bachelor's degree in computer science/information technology Key Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMS Role Overview: This position is for...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB's target state Marketing Platforms.You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for both...

  • Lead Data Engineer

    2 months ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead- Data Engineering

    1 week ago

    Gurgaon, Haryana, India FNP Full time

    Job Title:Lead-Data EngineeringDepartment:CETLocation:Corporate Office, GurgaonExp Range:8 to 10 YearsEducational Qualification:Bachelor's degree in computer science/information technologyKey Skills:Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the Ecommerce...