Data Engineer

2 weeks ago

Bengaluru, Karnataka, India NucleusTeq Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Responsibilities

  • Design and Develop: Build and maintain scalable data platform frameworks leveraging Big Data technologies (Spark, Hadoop, Kafka, Hive, etc. ) and GCP services (Big Query, Dataflow, Pub/Sub, etc. ).
  • Data Pipeline Development: Develop, optimize, and manage batch and real-time data pipelines to support business intelligence, analytics, and AI/ML workloads.
  • Java Development: Utilize Java to build efficient, high-performance data processing applications and frameworks.
  • Cloud Architecture: Design and implement cloud-native data solutions on GCP, ensuring reliability, security, and cost efficiency.
  • ETL and Data Integration: Work with structured and unstructured data sources, integrating data from multiple systems into a unified platform.
  • Performance Tuning: Optimize data processing performance by fine-tuning Spark jobs, SQL queries, and distributed computing environments.
  • Collaboration: Work closely with data scientists, analysts, and software engineers to deliver high-quality data solutions.
  • Automation and Monitoring: Implement CI/CD pipelines for data workflows and set up monitoring solutions to track system health and performance.

Requirements

  • Strong proficiency in Java for data engineering and backend development (Spring Boot, microservices).
  • Hands-on experience with Big Data technologies (Hadoop, Spark, Kafka, Hive, HBase, etc. ).
  • Expertise in GCP services: Big Query, Dataflow, Pub/Sub, Cloud Storage, Composer (Airflow), Python Dataproc, etc.
  • Experience in developing data platform frameworks to support scalable and reusable data solutions.
  • SQL and NoSQL database experience (e. g., Big Query, PostgreSQL, Cassandra, MongoDB).
  • Knowledge of ETL/ELT processes and data modelling concepts.
  • Experience with CI/CD tools (Git, Jenkins, Terraform) and infrastructure as code (IaC).
  • Understanding of distributed computing principles and high-performance data processing.
  • Strong problem-solving skills and ability to work in a fast-paced, agile environment.

This job was posted by Akhil K from NucleusTeq.

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Urgent Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...

  • Senior, Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Business Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Experience: 4 to 6 YearsLocation: Hybrid/Bangalore]Employment Type: Full-TimeRole & responsibilitiesMust-Have Skills:46 years of experience in data engineering roles.Proven experience in data migration and conversion projects (SAP or non-SAP).Strong knowledge of ETL concepts, tools, and frameworks.Proficiency in SQL, Python, or other data scripting...

  • Data Visualization Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Req ID: 340987NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Visualization Engineer - Power BI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: As...