Lead Data Engineer

Role: Lead Data EngineerLocation: BangaloreYears of Experience: 6 -8 YearsAbout the function:At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We prioritize a tech-first mindset, where our engineering teams lead the charge in transforming the way people travel.Our culture encourages collaboration, creativity, and thought leadership, empowering engineers to challenge the status quo and develop impactful, game-changing solutions. At MMT, you'll work with the latest technologies, continually push boundaries, and have the chance to shape the future of travel.Join us and become part of a forward-thinking, tech-driven organization that thrives on innovation and continuous learning.About the team:MakeMyTrip as India's leading online travel company and provides petabytes of raw data which is helpful for business growth, analytical and machine learning needs.Data Platform Team is a horizontal function at MakeMyTrip to support various LOBs (Flights, Hotels, Holidays, Ground) and works heavily on streaming datasets which powers personalized experiences for every customer from recommendations to in-location engagement.Our team's key responsibilities are:- Design, construct, and maintain robust data systems and architectures - Develop and optimize data capture, storage, processing, serving, and querying platforms - Create data products for personalization, recommendation, customer segmentation, and intelligence - Enhance our Measurement platform for A/B experimentation - Contribute to our Feature Store, an internal unified data analytics platform - Participate in the development of our next-generation Travel Planner using Generative AI and Multi-Agent frameworks. - Implement and optimize data solutions for travel-specific use cases, such as: - Analyzing cross-city travel patterns to extend trip recommendations - Identifying correlations between hotel bookings in different areas to suggest complementary destinationsRequired Skills and Experience:- Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture - At least 6+ years of hands-on experience in Spark/BigData Tech stack - Expertise in stream processing engines like Spark Structured Streaming or Apache Flink - Analytical processing on Big Data using Spark - At least 4+ years of experience in Scala. Experience with Python will be a plus. - Hands-on administration, configuration management, monitoring, performance tuning of Spark workloads, Distributed platforms, and JVM based systems - At least 2+ years of cloud deployment experience – AWS | Azure | Google Cloud Platform - 2 or more product deployments of big data technologies – Business Data Lake, NoSQL databases etc - Awareness and decision-making ability to choose among various big data, NoSQL, analytics tools and technologies - Should have experience in architecting and implementing domain centric big data solutions - Ability to frame architectural decisions and provide technology leadership & direction - Excellent problem solving, hands-on engineering, and communication skillsAt MakeMyTrip, we're committed to innovation and excellence in the travel industry. Join us in shaping the future of travel through data-driven solutions and advanced technologies. If you're passionate about leveraging data to create exceptional travel experiences, we want to hear from you