Data Engineer 2

4 weeks ago

Bengaluru, Karnataka, India Yubi Full time

Data Engineer 2

Position Summary:

As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines and validating data.

Your contribution will be really crucial in keeping various data ingestion and processing pipelines running successfully. Along with ensuring the data points available in the data lake are up to date, valid and usable.

Technology Experience:

  • 3+ years of experience in data engineering.
  • Comfortable and hands on with the Python programming.
  • Strong experience in working with RDBMS and NoSQL systems.
  • Strong experience in working on AWS ecosystem with hands-on experience in working with different AWS components like Airflow, EMR , Redshift, S3, Athena, PySpark etc.
  • Strong experience in developing REST APIs with Python using frameworks like flask, fastapi.
  • Prior experience in working with crawling libraries like BeautifulSoup in Python would be desirable.
  • Proven ability to work with SQL queries, including writing complex queries to retrieve key metrics. Skilled in connecting to, exploring, and understanding upstream data.
  • Experience working with various data lake storage format types and ability to choose it based on the use cases.

Responsibilities:

  • Design and build scalable data pipelines that can handle large volumes of data.
  • Develop ETL/ELT pipelines and extract the data from any upstream sources and sync with the data lakes with the format of parquet, iceberg, delta formats.
  • Optimize and ensure the data pipelines are running successfully and ensure the business continuity.
  • Collaborate with cross functional teams and source all the data required for the business use cases.
  • Stay up-to-date with emerging data technologies and trends to ensure the continuous improvement of our data infrastructure and architecture
  • Follow best practices in data querying and manipulation to ensure data integrity.

  • Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: Key...

  • Urgent Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 268395NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Role...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time

    Job DescriptionReq ID: 330827NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Sr Developer - Data...

  • High Salary) Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key ResponsibilitiesData...

  • Etl / Data Engineer With Snowflake Experience

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 318488NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ETL Data Engineer with Snowflake Experience to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job...

  • GCP Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India CustomerLabs ❤️ 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • Digital Engineering Networking Engineer Specialist

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 336414 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore Karn taka IN-KA India IN At...

  • 3 Days Left Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key...

  • Digital Engineering Networking Engineer Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Networking Engineer Specialist to join our team in Bangalore, Karntaka (IN-KA), India (IN).At NTT...