Data Engineer 2

10 hours ago

Bangalore Urban, India Yubi Full time

Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines and validating data. Your contribution will be really crucial in keeping various data ingestion and processing pipelines running successfully. Along with ensuring the data points available in the data lake are up to date, valid and usable. Technology Experience: 3+ years of experience in data engineering. Comfortable and hands on with the Python programming. Strong experience in working with RDBMS and NoSQL systems. Strong experience in working on AWS ecosystem with hands-on experience in working with different AWS components like Airflow, EMR , Redshift, S3, Athena, PySpark etc. Strong experience in developing REST APIs with Python using frameworks like flask, fastapi. Prior experience in working with crawling libraries like BeautifulSoup in Python would be desirable. Proven ability to work with SQL queries, including writing complex queries to retrieve key metrics. Skilled in connecting to, exploring, and understanding upstream data. Experience working with various data lake storage format types and ability to choose it based on the use cases. Responsibilities: Design and build scalable data pipelines that can handle large volumes of data. Develop ETL/ELT pipelines and extract the data from any upstream sources and sync with the data lakes with the format of parquet, iceberg, delta formats. Optimize and ensure the data pipelines are running successfully and ensure the business continuity. Collaborate with cross functional teams and source all the data required for the business use cases. Stay up-to-date with emerging data technologies and trends to ensure the continuous improvement of our data infrastructure and architecture Follow best practices in data querying and manipulation to ensure data integrity.

  • Data Engineer 2

    3 weeks ago

    Bangalore Urban, India Yubi Full time

    Data Engineer 2Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines...

  • Data Engineer 2

    3 weeks ago

    Bangalore, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    3 days ago

    bangalore, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Principal Data Engineer

    2 weeks ago

    Bangalore Urban, India MakeMyTrip Full time

    Role: Principal Data EngineerLocation: BangaloreYears of Experience: 8-10 YearsAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip...

  • Data Engineer 2

    10 hours ago

    bangalore district, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Software Engineer Backend

    3 weeks ago

    Bangalore Urban, India Arcana Full time

    Join our dynamic team at the forefront of cutting-edge technology as we seek a SDE2 (Backend). Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your...

  • Senior Data Engineer – II

    2 weeks ago

    Bangalore Urban, India MakeMyTrip Full time

    Role: Senior Data Engineer – IILocation: BangaloreYears of Experience: 4-6 YearsAbout the function:At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We...

  • Software Engineer Backend

    10 hours ago

    Bangalore Urban, India Arcana Full time

    Join our dynamic team at the forefront of cutting-edge technology as we seek a SDE2 (Backend). Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your...

  • Senior Data Engineer

    1 week ago

    Bangalore Urban, India Sutherland Full time

    Location: Bangalore | Hyderabad | Chennai | MumbaiIf interested please reach out to me with your updated resume @Priti.Kumari@sutherlandglobal.comSenior Data EngineerAbout the Job: We’re transforming how we work by harnessing the power of AI, data, and digital innovation to accelerate the discovery and development of life-saving therapies. Our vision is to...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location.Looking for candidates with 5 to 7 years of experienceRelevant 5+ years into Data Engineering GCP Cloud Data bricks,Unity catalog, Python/Pyspark Terra form scripts