Data Engineer 2

4 days ago

bangalore, India Yubi Full time

Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines and validating data. Your contribution will be really crucial in keeping various data ingestion and processing pipelines running successfully. Along with ensuring the data points available in the data lake are up to date, valid and usable. Technology Experience: 3+ years of experience in data engineering. Comfortable and hands on with the Python programming. Strong experience in working with RDBMS and NoSQL systems. Strong experience in working on AWS ecosystem with hands-on experience in working with different AWS components like Airflow, EMR , Redshift, S3, Athena, PySpark etc. Strong experience in developing REST APIs with Python using frameworks like flask, fastapi. Prior experience in working with crawling libraries like BeautifulSoup in Python would be desirable. Proven ability to work with SQL queries, including writing complex queries to retrieve key metrics. Skilled in connecting to, exploring, and understanding upstream data. Experience working with various data lake storage format types and ability to choose it based on the use cases. Responsibilities: Design and build scalable data pipelines that can handle large volumes of data. Develop ETL/ELT pipelines and extract the data from any upstream sources and sync with the data lakes with the format of parquet, iceberg, delta formats. Optimize and ensure the data pipelines are running successfully and ensure the business continuity. Collaborate with cross functional teams and source all the data required for the business use cases. Stay up-to-date with emerging data technologies and trends to ensure the continuous improvement of our data infrastructure and architecture Follow best practices in data querying and manipulation to ensure data integrity.

  • Data Engineer 2

    4 weeks ago

    Bangalore, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    15 hours ago

    Bangalore Urban, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    15 hours ago

    bangalore district, India Yubi Full time

    Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring...

  • Data Engineer 2

    3 weeks ago

    Bangalore Urban, India Yubi Full time

    Data Engineer 2Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines...

  • Data Engineer 2

    4 days ago

    Bangalore, Karnataka, , India Yubi Group Full time ₹ 7,00,000 - ₹ 8,50,000 per year

    Data Engineer 2Position Summary:As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines...

  • Data Engineer

    3 days ago

    bangalore, India Collabera Full time

    Data Engineer REMOTE, INDIA Day to day: As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices. Your role involves creating scalable solutions that integrate machine learning and AI capabilities, implementing software engineering standards like...

  • Data Engineer

    2 days ago

    bangalore, India Collabera Full time

    Data Engineer REMOTE, INDIA Day to day: As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices. Your role involves creating scalable solutions that integrate machine learning and AI capabilities, implementing software engineering standards like...

  • Data Engineer

    3 days ago

    bangalore, India Weekday AI Full time

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-45 LPA)Min Experience: 2 yearsLocation: BengaluruJobType: full-timeWe are seeking a passionate and skilled Data Engineer with 2–5 years of experience to join our dynamic data team. The ideal candidate will have hands-on experience with Big Data technologies, Databricks, Data Lakes,...

  • Data Engineer

    3 weeks ago

    bangalore, India Cephei Infotech Full time

    Data Engineer (SQL & Python Expertise Required) Experience: 0.5-2 Years Company: Cephei Infotech Job Type: Full-Time About Us Cephei Infotech is a leading Data & Analytics-focused IT company , delivering scalable data engineering, business intelligence, and AI-driven solutions . We help businesses unlock the power of data through robust pipelines, real-time...

  • Data Engineer

    3 days ago

    bangalore, India YO HR Consultancy Full time

    Data Engineer/Senior Data Engineer Location: Chennai Experience: 2 - 8 Years Role Description The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets....