Lead Data Engineer

4 weeks ago

Gurgaon, Haryana, India United Airlines Full time

United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.

Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the world." drives us to be the best airline for our employees, customers, and everyone we serve, and we can only do that with a truly diverse and inclusive workforce. Our team spans the globe and is made up of diverse individuals all working together with cutting-edge technology to build the best airline in the history of aviation.

With multiple employee-run "Business Resource Group" communities and world-class benefits like health insurance, parental leave, and space available travel, United is truly a one-of-a-kind place to work that will make you feel welcome and accepted. Come join our team and help us make a positive impact on the world.

Job overview and responsibilities

United Airlines is seeking talented people to join the Data and Machine Learning Engineering team. The organization is responsible for leading data driven insights & innovation to support the Machine Learning needs for commercial and operational projects with a digital focus. This role will frequently collaborate with data scientists and data engineers. This role will design and implement key components of the Machine Learning Platform, business use cases, and establish processes and best practices.

· Build high-performance, cloud-native machine learning infrastructure and services to enable rapid innovation across United. Set up containers and Serverless platform with cloud infrastructure.

  • You will design and develop tools and apps to enable ML automation using AWS ecosystem.
  • Build data pipelines to enable ML models for batch and real-time data. Hands on development expertise of Spark and Flink for both real time and batch applications.
  • Support large scale model training and serving pipelines in distributed and scalable environment.
  • This position is offered on local terms and conditions within United's wholly owned subsidiary United Airlines Business Services Pvt. Ltd
  • Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded.

This position is offered on local terms and conditions. Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded. This position is for United Airlines Business Services Pvt. Ltd - a wholly owned subsidiary of United Airlines Inc.

United Airlines is an equal opportunity employer. United Airlines recruits, employs, trains, compensates, and promotes regardless of race, religion, color, national origin, gender identity, sexual orientation, physical ability, age, veteran status, and other protected status as required by applicable law.

Qualifications

Required

· 6 + years of software engineering experience with languages such as Python, Go, Java, Scala, Kotlin, or C/C++

· 4+ years of experience in machine learning, deep learning, and natural language processing.

· 3 + years of experience working in cloud environments (AWS preferred) - Kubernetes, Dockers, ECS and EKS

· 2 + years of experience with Big Data technologies such as Spark, Flink and SQLprogramminG.

· 3 + years of experience with cloud-native DevOps, CI/CD.

· 1+ years of experience with Generative AI/LLMs.

· Strong software engineering experience with Python and at least one additional language such as Go, Java, or C/C++

· Familiarity with data science methodologies and frameworks (e.g., PyTorch, Tensorflow) and preferably building and deploying production ML pipelines.

· Experience in ML model life cycle development experience and prefer experience to common algorithms like XGBoost, CatBoost, Deep Learning, etc.

· Experience setting up and optimizing data stores (RDBMS/NoSQL) for production use in the ML app context

· Cloud-native DevOps, CI/CD experience using tools such as Jenkins or AWS CodePipeline; preferably experience with GitOps using tools such as ArgoCD, Flux, or Jenkins X

· Experience with generative models such as GANs, VAEs, and autoregressive models.

· Prompt engineering: Ability to design and craft prompts that evoke desired responses from LLMs.

· LLM evaluation: Ability to evaluate the performance of LLMs on a variety of tasks, including accuracy, fluency, creativity, and diversity.

· LLM debugging: Ability to identify and fix errors in LLMs, such as bias, factual errors, and logical inconsistencies.

· LLM deployment: Ability to deploy LLMs in production environments and ensure that they are reliable and secure.

· Experience with LLMOps (Large Language Model Operations) to manage the end-to-end lifecycle of large language models.

Preferred

· Computer Science or related STEM field

Equal Opportunity Employer - Minorities/Women/Veterans/Disabled/LGBT

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies Write and tune complex Java, MapReduce, Pig and Hive jobs Adapt quickly to change in requirements...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    2 months ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India Visionyle Solutions Full time

    Role : Lead Data EngineerExp : 7-10 YearsLocation : Gurgaon (Hybrid) - 3 days WFORequirements : Have a strong technical background, including 8+ years of experience in designing and engineering large scale systems. At least 3 years of experience working as lead in designing, development and deploying data integration and ETL solutions in a data warehousing...

  • Data Platform Engineering Lead

    1 month ago

    Gurgaon, Haryana, India NatWest Group Full time

    Join us as a Data Platform Engineering LeadThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank through developing innovative data driven platform and framework solutions, inspiring to be commercially successful through insight,...

  • Lead- Data Engineering

    1 week ago

    Gurgaon, Haryana, India FNP Full time

    Job Title: Lead- Data Engineering Department: CET Location: Corporate Office, Gurgaon Exp Range: 8 to 10 Years Educational Qualification: Bachelor's degree in computer science/information technology Key Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMS Role Overview: This position is for...

  • Lead Data Engineer

    2 months ago

    Gurgaon, Haryana, India United Airlines Full time

    DescriptionUnited's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people....

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    DescriptionUnited's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people....

  • Lead Data Engineer

    1 week ago

    Gurgaon, Haryana, India TransOrg Analytics Full time

    Location : Gurgaon/Mumbai Job ID : DE2001 Job Type : Full time Experience : 5-8 years Why would you like to join us? TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our...

  • Lead- Data Engineering

    1 week ago

    Gurgaon, Haryana, India FNP Full time

    Job Title:Lead-Data EngineeringDepartment:CETLocation:Corporate Office, GurgaonExp Range:8 to 10 YearsEducational Qualification:Bachelor's degree in computer science/information technologyKey Skills:Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the Ecommerce...

  • Lead/Senior Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • OfBusiness - Lead Engineer - Data Science

    1 week ago

    Gurgaon, Haryana, India OFB TECH Pvt Ltd Full time

    We are looking for a highly skilled AI/ML Lead to join our team. The ideal candidate will have 5-7 years of experience in artificial intelligence and machine learning, leading successful projects. As the AI/ML Lead, you will drive the development of AI and ML solutions in the FinTech sector to tackle business challenges. You'll lead a team of data scientists...

  • Lead Data Engineer

    2 months ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.Our Values: At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose: "Connecting people. Uniting the...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India Expedify Full time

    Data Engineer - Job Description Exp - min 1 year Salary Budget- 4-6 lpa Overview is looking for an intelligent and detail-oriented Data Engineer, to join our ever expanding team of data engineering and analytics. The hire will be responsible for building and optimizing our data pipeline architecture, optimizing data flow and suggesting the right set of...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business's operational and analytics databases. The Data Engineer works with the business's software engineers, data analytics teams, data scientists. data warehouse engineers and business intelligence experts and data visualization specialists to understand and aid in the...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB's target state Marketing Platforms.You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for both...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview : A seasoned data team member with a good grasp of both business and technical aspects.Good familiarity with data stack Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc Demonstrated experience of building...