Senior Data Engineering Lead

2 weeks ago

Gurgaon, Haryana, India Expedia Group Full time

Expedia Group: Senior Machine Learning Engineer

At Expedia Group, we're in the business of helping travelers make their next trip easier and more enjoyable. We're looking for a Senior Machine Learning Engineer to join our team and help us build innovative solutions that make a real difference in people's lives.

This role will be part of our Machine Learning Engineering group, which partners with our Machine Learning Science counterparts to use AI/ML to collaboratively transform Expedia's data assets into intelligent and real-time insights. Our mission is to support a variety of applications used by 1000+ market managers, analysts, our supply partners, and our travelers.

What You'll Do:

  • Lead the design and development of large-scale batch and real-time ML Services
  • Design, implement, and deploy large-scale data pipelines (both real-time and batch) and back-end services
  • Lead the end-to-end product life cycle for mid-to-large machine learning/data engineering projects: design, development, model validation/testing, model deployment, and providing operational excellence and support
  • Find and advocate for industry standards and best practices in machine learning engineering methodologies, techniques, and technologies
  • Contribute to advancing the team's design methodology and quality programming practices and mentor junior team members to adapt best practices
  • Innovate and implement new ideas to solve complex software problems and prototype creative solutions to enable product MVPs
  • Independently understand scheduling, cost constraints, and impact to other teams; and make resource and architectural trade-offs based on those factors
  • Anticipate and prevent problems and roadblocks, before they occur, and present technical issues and their impact to leadership
  • Lead, coordinate, and collaborate on multiple concurrent and complex cross-organizational initiatives
  • Effectively build and maintain a network of key contacts across the company, and leverage these contacts to achieve results
  • Communicate and work effectively with geographically distributed cross-functional teams

Who You Are:

  • Bachelor's or Master's degree in software engineering, computer science, informatics, or a related technical field; or equivalent related professional experience
  • 8 to 10+ years of work experience in software engineering
  • 4+ years of experience in designing and implementing Big Data/ML applications (data ingestion, real-time data processing, and batch analytics) in Spark Streaming, Kafka, Hadoop
  • Experience on Hadoop-ecosystem technologies in particular MapReduce, Spark, Hive, YARN
  • Experience in productionizing machine learning models including feature engineering, model scalability, model validation, and model deployment
  • Solid server-side programming skills in multiple languages (Scala/Java and Python), and hands-on experience in OOAD, design patterns, NoSQL, and SQL
  • Strong experience with cloud computing platforms (AWS, EMR, Kubernetes, Docker)
  • Strong experience working with ML platforms (Databricks, SageMaker, etc.)
  • Solid knowledge in SQL (T-SQL/PL-SQL), ETL, and data modeling
  • Experience with microservice architecture, and design
  • Experience on machine learning toolkits like Spark MLlib, H20, scikit-learn, R, and ML techniques
  • Strong command with machine learning libraries such as PyTorch and TensorFlow and knowledge of common integration patterns for serving inference with them
  • Familiar with training models with very large datasets- strategies for parallelizing and optimizing the training jobs especially with GPUs or large compute
  • You have hands-on experience with workflow management tools (e.g. Airflow)
  • Familiar with machine learning inference at scale. Can instrument streaming or parallel inference tasks to accommodate large traffic or volume of data
  • Experience working with Agile/Scrum methodologies
  • Experience on Recommender Systems is a plus
  • Familiarity with the e-commerce or travel industry

  • Senior Data Engineering Lead

    1 month ago

    Gurgaon, Haryana, India RENOUS EXTENSERVE PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineering Lead**Job Summary:** We're seeking a highly experienced Senior Data Engineering Lead to join our engineering team in building and deploying large-scale data systems. The ideal candidate will have a strong technical background, including 8+ years of experience in designing and engineering large-scale systems, and at...

  • Senior Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India HuQuo Full time

    Job Title: Senior Lead Data EngineerAbout the RoleAt HuQuo, we are seeking an experienced Senior Lead Data Engineer to lead our data engineering team. The ideal candidate will have a strong background in software development and delivery, with a proven track record of leading large-scale data applications.Key ResponsibilitiesLead the development and...

  • Senior Data Engineering Lead

    4 weeks ago

    Gurgaon, Haryana, India Acquire Bright Minds Full time

    Data Engineering Leadership RoleAbout the JobAt Acquire Bright Minds, we are seeking a Senior Data Engineering Lead to lead our data engineering team. Key ResponsibilitiesDesign, develop, and implement efficient data integration and ETL pipelines using Talend or other relevant tools.Ensure data quality, consistency, and accuracy throughout the data...

  • Senior Data Engineer Lead

    2 days ago

    Gurgaon, Haryana, India Genpact Full time

    About Genpact">Genpact is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients.">We serve and transform leading enterprises, including the Fortune Global 500, with our...

  • Senior Data Engineer

    1 month ago

    Gurgaon, Haryana, India Habilelabs Pvt. Ltd. Full time

    Job Title: Senior Data EngineerAbout Habilelabs Pvt. Ltd.Habilelabs Pvt. Ltd. is a leading technology company that specializes in developing innovative solutions for the data engineering space. We are seeking a highly skilled and motivated Senior Data Engineer to join our development team in Gurgaon.Job Description:We are looking for a talented Senior Data...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Elite recruitments Full time

    Job Title: Senior Data EngineerJob Summary:Elite recruitments is hiring a seasoned data engineer to join our team. As a senior data engineer, you will be responsible for building efficient data pipelines using tools like Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio. You will also be responsible for understanding the need for...

  • Data Engineering Senior Manager

    3 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    Job Overview At United Airlines, we're committed to innovation and excellence in our digital technology solutions. As a Senior Manager, Data Engineering & Development, you'll be part of a team responsible for designing and developing enterprise-wide data and analytics environments. Key Responsibilities: Leading a team of engineers in the development of big...

  • Senior Data Engineering Manager

    2 days ago

    Gurgaon, Haryana, India Metyis Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineering Lead to join our team at Metyis. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data processing solutions.About the RoleThe ideal candidate will have 7+ years of experience in managing and leading data engineering projects,...

  • Senior Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India TETRAHED INC Full time

    Role: Lead Data EngineerExperience: 6-10 YrsLocation: GurugramJob Description:As a seasoned data engineering leader, you will oversee the design, development, and deployment of large-scale data systems. Your expertise in data warehousing and business intelligence will drive the adoption of best practices and standards in data integration and ETL solutions.We...

  • Senior Data Engineer

    1 month ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at BayOne Solutions. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining large-scale data engineering systems on cloud platforms like Azure, AWS, and GCP.Key Responsibilities:Design and implement data pipelines...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Nagarro Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Nagarro. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and solutions.Key Responsibilities:Design and develop data models, data warehouses, and data lakes using SAP HANA...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India FedEx Full time

    Data Engineer - SeniorFedEx is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures that support our business operations.Key Responsibilities:Develop and maintain scalable data pipelines and...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Nagarro Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Nagarro. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Azure cloud services and Python.Key Responsibilities:Design and develop data processing systems...

  • Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India Acuity Knowledge Partners Full time

    Job Description:Acuity Knowledge Partners seeks a highly skilled Senior Data Engineer to support our data engineering and maintenance tasks. The ideal candidate will have a strong background in Python, experience with Flask, and a solid understanding of data structures and algorithms.Key Responsibilities:Design and implement efficient, scalable, and secure...

  • Senior Software Engineer

    4 weeks ago

    Gurgaon, Haryana, India NTT DATA Full time

    Job Title: Senior Software EngineerAs a Senior Software Engineer at {company}, you will be responsible for designing, developing, and maintaining complex software applications. You will work closely with cross-functional teams to ensure timely delivery of high-quality software products.Responsibilities:Design and develop software applications using a variety...

  • Senior Data Science Lead

    7 days ago

    Gurgaon, Haryana, India Nagarro Full time

    Job OverviewNagarro is seeking a highly skilled Senior Staff Engineer, Data Science to join our team. This individual will be responsible for leading data science efforts and driving business growth through data-driven insights.The ideal candidate will have 5+ years of experience in Machine Learning Fundamentals, Data Analysis & Visualization, and Statistics...

  • Senior Big Data Engineer

    4 days ago

    Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...

  • Senior Data Engineer

    1 month ago

    Gurgaon, Haryana, India Nagarro Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Nagarro. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Databricks.Key Responsibilities:Design and implement data pipelines using...

  • Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India Publicis Sapient Full time

    Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at Publicis Sapient. In this role, you will be responsible for defining and executing data strategy for clients.Data Integration, Governance & WranglingData Storage and Computation Frameworks, Performance OptimizationsAnalytics & VisualizationsInfrastructure & Cloud...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Publicis Sapient Full time

    Position OverviewAs a Senior Data Engineer at Publicis Sapient, you will play a key role in designing and implementing data engineering solutions that drive business value for our clients. With a strong background in big data technologies, you will translate client requirements into technical designs and lead the development of custom solutions.Your Key...