Lead Data Engineer

1 month ago

Gurugram, India United Airlines Full time

Description

United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.

Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the world." drives us to be the best airline for our employees, customers, and everyone we serve, and we can only do that with a truly diverse and inclusive workforce. Our team spans the globe and is made up of diverse individuals all working together with cutting-edge technology to build the best airline in the history of aviation.

With multiple employee-run "Business Resource Group" communities and world-class benefits like health insurance, parental leave, and space available travel, United is truly a one-of-a-kind place to work that will make you feel welcome and accepted. Come join our team and help us make a positive impact on the world.

Job overview and responsibilities

United Airlines is seeking talented people to join the Data and Machine Learning Engineering team. The organization is responsible for leading data driven insights & innovation to support the Machine Learning needs for commercial and operational projects with a digital focus. This role will frequently collaborate with data scientists and data engineers. This role will design and implement key components of the Machine Learning Platform, business use cases, and establish processes and best practices.

· Build high-performance, cloud-native machine learning infrastructure and services to enable rapid innovation across United. Set up containers and Serverless platform with cloud infrastructure.

  • You will design and develop tools and apps to enable ML automation using AWS ecosystem.

  • Build data pipelines to enable ML models for batch and real-time data. Hands on development expertise of Spark and Flink for both real time and batch applications.

  • Support large scale model training and serving pipelines in distributed and scalable environment.

  • This position is offered on local terms and conditions within United’s wholly owned subsidiary United Airlines Business Services Pvt. Ltd

  • Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded.

This position is offered on local terms and conditions. Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded. This position is for United Airlines Business Services Pvt. Ltd - a wholly owned subsidiary of United Airlines Inc.

United Airlines is an equal opportunity employer. United Airlines recruits, employs, trains, compensates, and promotes regardless of race, religion, color, national origin, gender identity, sexual orientation, physical ability, age, veteran status, and other protected status as required by applicable law.

Qualifications

Required

· 6 + years of software engineering experience with languages such as Python, Go, Java, Scala, Kotlin, or C/C+· 4+ years of experience in machine learning, deep learning, and natural language processing.

· 3 + years of experience working in cloud environments (AWS preferred) - Kubernetes, Dockers, ECS and EKS

· 2 + years of experience with Big Data technologies such as Spark, Flink and SQLprogramminG.

· 3 + years of experience with cloud-native DevOps, CI/CD.

· 1+ years of experience with Generative AI/LLMs.

· Strong software engineering experience with Python and at least one additional language such as Go, Java, or C/C+· Familiarity with data science methodologies and frameworks (e.g., PyTorch, Tensorflow) and preferably building and deploying production ML pipelines.

· Experience in ML model life cycle development experience and prefer experience to common algorithms like XGBoost, CatBoost, Deep Learning, etc.

· Experience setting up and optimizing data stores (RDBMS/NoSQL) for production use in the ML app context

· Cloud-native DevOps, CI/CD experience using tools such as Jenkins or AWS CodePipeline; preferably experience with GitOps using tools such as ArgoCD, Flux, or Jenkins X

· Experience with generative models such as GANs, VAEs, and autoregressive models.

· Prompt engineering: Ability to design and craft prompts that evoke desired responses from LLMs.

· LLM evaluation: Ability to evaluate the performance of LLMs on a variety of tasks, including accuracy, fluency, creativity, and diversity.

· LLM debugging: Ability to identify and fix errors in LLMs, such as bias, factual errors, and logical inconsistencies.

· LLM deployment: Ability to deploy LLMs in production environments and ensure that they are reliable and secure.

· Experience with LLMOps (Large Language Model Operations) to manage the end-to-end lifecycle of large language models.

Preferred

· Computer Science or related STEM field

Equal Opportunity Employer - Minorities/Women/Veterans/Disabled/LGBT

  • Lead Data Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    7 hours ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    1 week ago

    gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    1 week ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Eucloid - Data Engineer - Azure Databricks

    1 week ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Senior Data Engineer - Azure Databricks

    1 week ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Lead Data Engineer

    1 month ago

    gurugram, India United Airlines Full time

    Description United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions. Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose:...

  • Lead- Data Engineering

    3 weeks ago

    gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CET Location: Corporate Office, Gurgaon Exp Range: 8 to 10 Years Educational Qualification: Bachelor’s degree in computer science/information technology Key Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMS Role Overview: This position...

  • Lead- Data Engineering

    2 weeks ago

    Gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CETLocation: Corporate Office, GurgaonExp Range: 8 to 10 YearsEducational Qualification: Bachelor’s degree in computer science/information technologyKey Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the...

  • Lead- Data Engineering

    3 weeks ago

    Gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CETLocation: Corporate Office, GurgaonExp Range: 8 to 10 YearsEducational Qualification: Bachelor’s degree in computer science/information technologyKey Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the...

  • Lead Data Engineer

    8 hours ago

    Gurugram, India TransOrg Analytics Full time

    Location : Gurgaon/Mumbai Job ID : DE2001 Job Type : Full time Experience : 5-8 years Why would you like to join us? TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our products...

  • Lead - Data Engineer

    1 week ago

    Gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only& Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center.As a Lead Data Engineer, you will require a wide range of strengths and capabilities including:Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcomes.Play a key role in our advanced...

  • Lead - Data Engineer

    1 week ago

    gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only & Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center. As a Lead Data Enginee r, you will require a wide range of strengths and capabilities including :Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcome s.Play a key role in our...

  • Lead - Data Engineer

    1 week ago

    Gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only& Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center.As a Lead Data Engineer, you will require a wide range of strengths and capabilities including:Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcomes.Play a key role in our advanced...

  • Lead Data Engineer

    1 week ago

    Gurgaon/Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    5 days ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    6 hours ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...