Data Engineer 2

17 hours ago

bangalore district, India Yubi Full time

Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines and validating data. Your contribution will be really crucial in keeping various data ingestion and processing pipelines running successfully. Along with ensuring the data points available in the data lake are up to date, valid and usable. Technology Experience: 3+ years of experience in data engineering. Comfortable and hands on with the Python programming. Strong experience in working with RDBMS and NoSQL systems. Strong experience in working on AWS ecosystem with hands-on experience in working with different AWS components like Airflow, EMR , Redshift, S3, Athena, PySpark etc. Strong experience in developing REST APIs with Python using frameworks like flask, fastapi. Prior experience in working with crawling libraries like BeautifulSoup in Python would be desirable. Proven ability to work with SQL queries, including writing complex queries to retrieve key metrics. Skilled in connecting to, exploring, and understanding upstream data. Experience working with various data lake storage format types and ability to choose it based on the use cases. Responsibilities: Design and build scalable data pipelines that can handle large volumes of data. Develop ETL/ELT pipelines and extract the data from any upstream sources and sync with the data lakes with the format of parquet, iceberg, delta formats. Optimize and ensure the data pipelines are running successfully and ensure the business continuity. Collaborate with cross functional teams and source all the data required for the business use cases. Stay up-to-date with emerging data technologies and trends to ensure the continuous improvement of our data infrastructure and architecture Follow best practices in data querying and manipulation to ensure data integrity.

  • Data Engineer 2

    4 weeks ago

    Bangalore, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    4 days ago

    bangalore, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    17 hours ago

    Bangalore Urban, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer

    1 week ago

    bangalore district, India Aezion, Inc Full time

    Sr. Data Engineer Location: Bangalore /Coimbatore Job Type: Full-Time Required Skills and Qualifications: 8+ years of experience in Data Engineering and Analytics, with at least 2+ years in a leadership role. Proven experience managing global teams, both onsite and offshore. Strong hands-on technical background in Big Data, streaming Platforms, Databricks,...

  • Data Engineer

    1 week ago

    bangalore district, India Networth Corp Full time

    Responsibilities: Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services End to end development lifecycle of complex large-scale and multi-user applications Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios Big Data ETL considering...

  • Data Engineer

    1 week ago

    bangalore district, India Alp Consulting Ltd. Full time

    Dear Candidate Please find the below JD for your reference: Hands-on experience with AWS or similar cloud platform building data engineering solutions for analytics and science. (3+ years) Must have experience building complex data pipelines – batch and/or real time event-based processing (3+ years) Strong experience in designing, building, and maintaining...

  • Data Center Engineer

    3 days ago

    bangalore district, India Infogain Full time

    As a Data Centre Provisioning Engineer, you will be responsible for supporting the deployment, activation, and operational excellence of hyperscale data centre network infrastructure. You will collaborate with cross-functional teams and external partners to ensure seamless provisioning, troubleshooting, and optimization of network systems. Job Location:...

  • SDE - 2 - Data Platform

    1 week ago

    bangalore district, India slice Full time

    About Us: slice A new bank for a new India. slice’s purpose is to make the world better at using money and time, with a major focus on building the best consumer experience for your money. We’ve all felt how slow, confusing, and complicated banking can be. So, we’re reimagining it. We’re building every product from scratch to be fast, transparent,...

  • Principal Data Engineer

    1 week ago

    bangalore district, India MakeMyTrip Full time

    Role: Principal Data Engineer Location: Bangalore Years of Experience: 8-10 Years About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the traveler -...

  • Azure Data Engineer

    19 hours ago

    bangalore district, India Inumellas Full time

    Position - Azure Data Engineer Role - Data Engineer & Senior Data Engineer Exp range - 4 Yrs to 10 Yrs Position Type - Permanent FTE Locations - Bengaluru, Chennai, Hyderabad Company - Global Leader in Data Analytics, Cloud and AI Notice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec) Skills & Experience: 5+ years of...