MakeMyTrip - Senior Data Engineer I/II - Spark/Scala

Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...

Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

Responsibilities :- Train and deploy best in class deep learning models for ranking, pricing, recommendation, representation learning products.- Work with stakeholders at various stages of project, lead project development from inception to completion.- Be a SQL python ninja, understand data thoroughly, build smart AI/ML systems.- Opportunity to work with...

Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...

Roles and Responsibilities :- Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Ola group business growth and improve the product experience.- Evangelize high quality software engineering practices towards building data infrastructure and pipelines at scale.- Lead data engineering projects to ensure...

Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

Job Description :- Should have hands on experience in Software development for at least 9 years. - Should have hands-on experience in order to handle project work as Technical Lead for at least 2 yr.- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture...

Our client is a global investment banking company having its headquarters in the US with 75000+ employees globally and is looking for a Scala / Spark to join their Bangalore regional team.Note : Looking for candidates who can join within 30daysWork Mode : Hybrid Experience : 5 to 8 yearsSome of the key responsibilities will include :- Understand and...

Position: Sr.Azure Data EngineerQualification: Bachelor of Engineer / Computer Science/ MCA / MS Comp Si + Overall 15-20 years experience with 5+ years experience in developing AI solutions.Willing to work with Start up Senior Data Engineers are responsible for delivering high quality modern data solutions through collaboration with our team and our...

What You'll Do :- Solely own your product; Build the product from scratch- Collaborate with the business team to understand business requirements and define tech roadmap- Working on complex architectural problems- Have an understanding of loopholes in current system/architecture which can potentially break in future and push towards solving them with...

Job Description :- Experience working with distributed technology tools for- developing Batch and Streaming- pipelines using SQL, Spark, Python, PySpark [4+ years], Airflow [3+ years], Scala [2+ years].- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark...

Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...

Job Description- Must have 4+ years of IT experience- Must have good experience in Spark and Scala- Develop and maintain big data applications using Spark and Scala, ensuring high performance, reliability, and scalability.- Implement Spark data processing techniques, performance tuning, memory management, fault tolerance mechanisms, and scalability...

Primary skillset :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python [6+ years], Airflow [4+ years], Scala [4+ years].- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming languages, technologies, and frameworks.- Strong skills building...

Job Description :Our client is a Limited is a platform in the financial services sector in India set up primarily with the mission of catering to the diverse credit requirements of under-served households and businesses, who is growing their presence in India and is searching for Associate Data Engineers to join their team.Some of the key responsibilities...

We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

Job Description :As a Data Engineer / Senior Data Engineer you serve as a specialist in the engineering team that supports the product. You help develop and gain insight in the application architecture. You can distill an abstract architecture into concrete design and influence the implementation. You show expertise in applying the appropriate software...

Responsibilities : Design and build parts of our data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources using the latest Big Data technologies. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for...

Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...

Job Description :Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutionsStrong expertise in end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWSProficient in Lambda or Kappa ArchitecturesShould be aware of Data Management concepts and Data...