Lead Data Engineer

1 week ago

Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time US$ 1,04,000 - US$ 1,30,878 per year

Role summary

Seeking a Lead Software Engineer to own the architecture, delivery, and operations of complex, distributed systems, leading a team to build resilient services and robust data pipelines using Java/Spring Boot on cloud and big‑data platforms, with hands-on expertise across Hadoop and GCP.

Key responsibilities

Lead architecture and end-to-end delivery of complex, scalable microservices and data-intensive systems, ensuring quality, security, and performance in production.

Design and implement reliable data ingestion, transformation, and delivery pipelines; assemble large datasets and optimize data flows for batch and .

Build Spring Boot microservices and APIs, integrate with mestreamingssaging/streaming, and enforce coding standards, reviews, and best practices across teams.

Define and maintain CI/CD pipelines and deployment automation; collaborate with DevOps, QA, and product to ship features safely and frequently.

Troubleshoot complex issues across services and data jobs; drive root-cause analysis and continuous improvement of reliability and cost.

Translate business requirements into technical solutions; partner with stakeholders to meet functional and non-functional needs at scale.

Technical requirements

Strong expertise in Java (8+) and Spring Boot, building RESTful microservices and enterprise integrations.

Hands-on Hadoop ecosystem experience (e.g., HDFS, Hive/Spark, Oozie/Sqoop), including building production-grade data pipelines.

Google Cloud Platform experience across data services such as BigQuery, Dataproc, Cloud Storage, Dataflow/Composer, and IAM/networking basics.

CI/CD and automation with Git-based workflows; familiarity with containerization and cloud deployment patterns.

Proven delivery of complex systems with attention to observability, security, and scalability under real-world load.

Nice to have

Experience with schema management, data quality, lineage, and cost optimization on cloud data platforms.

Exposure to multi-cloud or hybrid data movement and orchestration.

Leadership and ways of working

Mentor and coach engineers; set technical direction, conduct reviews, and raise the bar on engineering excellence.

Champion standards for reliability, security, and performance; drive cross-team collaboration with product, UX, and platform functions.

Operate within Agile practices, contributing to planning, demos, and retrospectives, and managing delivery risks proactively.

Qualifications

Bachelor's/master's in computer science or related field, or equivalent practical experience.

8–12+ years in software engineering with 3+ years in a lead role delivering complex systems and data pipelines in production.

hiring #java #springboot #datapiplines #bigquery #dataproc #hadoop #softwareengineer #hybridmode #bangaloreocation #immediatejoiner

  • Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Lead Data Scientist

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Data Scientist - Computer Vision & Generative AI to join our team in Bangalore, Karnātaka (IN-KA), India (IN). We are seeking...

  • Associate Lead Data Scientist

    3 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modelled around expertise and mutual respect...

  • Sr. Data Engineer Data Science

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Lead Data Scientist

    1 week ago

    Bengaluru, Karnataka, India Aptus Data Labs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Description: Senior/lead Data ScientistLocation: Bangalore/WFHEmployment Type: Full-timeAbout the RoleWe are seeking a highly skilled Senior /lead Data Scientist with strong expertise in Artificial Intelligence (AI), Machine Learning (ML), Deep Learning, and Natural Language Processing (NLP). The ideal candidate will also have hands-on exposure to...

  • Lead Data Scientist

    1 day ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are currently seeking a Lead Data Scientist - Computer Vision & Generative AI to join our team in Bangalore, Karntaka (IN-KA), India (IN).We are seeking a highly skilled and experienced Lead Data Scientist with 7+ years of expertise in Machine Learning, Deep Learning (especially Computer Vision), and Generative AI. The ideal candidate will lead the design...

  • Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...