Data Engineer

4 weeks ago

Bengaluru, India NucleusTeq Full time

Responsibilities

  • Design and Develop: Build and maintain scalable data platform frameworks leveraging Big Data technologies (Spark, Hadoop, Kafka, Hive, etc. ) and GCP services (Big Query, Dataflow, Pub/Sub, etc. ).
  • Data Pipeline Development: Develop, optimize, and manage batch and real-time data pipelines to support business intelligence, analytics, and AI/ML workloads.
  • Java Development: Utilize Java to build efficient, high-performance data processing applications and frameworks.
  • Cloud Architecture: Design and implement cloud-native data solutions on GCP, ensuring reliability, security, and cost efficiency.
  • ETL and Data Integration: Work with structured and unstructured data sources, integrating data from multiple systems into a unified platform.
  • Performance Tuning: Optimize data processing performance by fine-tuning Spark jobs, SQL queries, and distributed computing environments.
  • Collaboration: Work closely with data scientists, analysts, and software engineers to deliver high-quality data solutions.
  • Automation and Monitoring: Implement CI/CD pipelines for data workflows and set up monitoring solutions to track system health and performance.

Requirements

  • Strong proficiency in Java for data engineering and backend development (Spring Boot, microservices).
  • Hands-on experience with Big Data technologies (Hadoop, Spark, Kafka, Hive, HBase, etc. ).
  • Expertise in GCP services: Big Query, Dataflow, Pub/Sub, Cloud Storage, Composer (Airflow), Python Dataproc, etc.
  • Experience in developing data platform frameworks to support scalable and reusable data solutions.
  • SQL and NoSQL database experience (e. g., Big Query, PostgreSQL, Cassandra, MongoDB).
  • Knowledge of ETL/ELT processes and data modelling concepts.
  • Experience with CI/CD tools (Git, Jenkins, Terraform) and infrastructure as code (IaC).
  • Understanding of distributed computing principles and high-performance data processing.
  • Strong problem-solving skills and ability to work in a fast-paced, agile environment.

This job was posted by Akhil K from NucleusTeq.

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA, Inc. Full time

    Req ID: We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN). "Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Snowflake Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties:...

  • Snowflake Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...