Data Engineer

3 days ago


Bengaluru, Karnataka, India Prodapt Full time ₹ 5,00,000 - ₹ 15,00,000 per year
Overview

Role: Data Engineer

Location: Bengaluru, India

Responsibilities

Project description:

Design, develop, and maintain a robust, end-to-end data analytics pipeline for real-time data processing and visualization. Take ownership of the entire project lifecycle, from architectural design and component integration to deployment, security, and presentation.

Work on data analytics platform (on GKE/GDC air gapped) to provide real-time hot spot prediction and ride recommendations for taxi drivers. The application will use the NYC taxi dataset and showcase the capabilities of Kafka, Spark, HBase, Solr, Trino, Apache Airflow, Apache Superset and Apache Ranger.

Requirements

Must Have:
Big Data Ecosystem: Apache Kafka, Apache Spark, HBase, Apache Solr, and Trino
Tools & Orchestration: Apache Airflow, Apache Superset, and Apache Ranger
Databases: PostgreSQL, HBase
Languages: Python
Cloud Platforms: Google Cloud Platform (GCP), Google Distributed Cloud (GDC)
Query Engine: Trino
DevOps: Kubernetes, Docker


  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    1 week ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data Senior Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Senior, Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Data Engineer

    5 days ago


    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...