Lead Big Data Engineer

1 day ago


Delhi, Delhi, India Kloud9 Full time
About the Job

Kloud9 is seeking a highly skilled Lead Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for leading the design and implementation of large-scale data engineering projects on the Google Cloud Platform (GCP).

The ideal candidate will have extensive experience in building data ingestion pipelines, managing big data processing using Apache Spark, and integrating SAP S/4HANA with GCP cloud infrastructure. You will work closely with our team to develop and implement end-to-end data architectures leveraging GCP services such as Big Query, Cloud Storage, Dataflow, Pub/Sub, and Cloud Composer.

Responsibilities and Requirements
  • Design and implement scalable data architectures leveraging GCP services for large-scale data ingestion and processing.
  • Build and optimize large-scale data pipelines using Apache Spark on GCP (via Dataproc or other Spark services) ensuring high performance and scalability.
  • Lead the integration of SAP S/4HANA data with GCP for real-time and batch data processing, managing data extraction, transformation, and loading (ETL) processes from SAP S/4HANA into cloud storage and data lakes.
  • Develop and manage scalable data ingestion pipelines for structured and unstructured data using tools like Cloud Dataflow, Cloud Pub/Sub, and Apache Spark.
  • Provide architectural guidance for designing secure, scalable, and efficient data solutions on the Google Cloud Platform.
Estimated Salary

The estimated salary for this position is $180,000 - $250,000 per year.



  • Delhi, Delhi, India Aidetic Full time

    Aidetic seeks a seasoned Data Engineering Lead to oversee the design and deployment of scalable data architectures and ETL pipelines. As a key member of our team, you will lead a group of data engineers in building, maintaining, and optimizing complex data solutions for real-world projects.With 4+ years of experience in big data technologies, including...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    About NucleusTeq Consulting Pvt. Ltd.NucleusTeq Consulting Pvt. Ltd. is a technology consulting firm that helps businesses leverage big data and analytics to drive business outcomes.Salary and Benefits:The estimated salary for this position is around $120,000 - $180,000 per annum, depending on experience. We also offer a comprehensive benefits package,...

  • Data Engineering Lead

    3 weeks ago


    Delhi, Delhi, India Lancetech solutions Full time

    **About Lancetech Solutions**We are a cutting-edge technology company that provides innovative solutions to meet the ever-evolving needs of our clients. As a data engineering lead, you will play a vital role in shaping the future of our data-driven products.**Salary and Benefits**We offer a competitive salary range of $180,000 - $250,000 per annum, depending...

  • Big Data Engineer

    3 weeks ago


    Delhi, Delhi, India Wipro Full time

    We are seeking a highly skilled Big Data Engineer to join our team at Wipro. As a Big Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems.The ideal candidate will have a strong background in Hadoop and related technologies such as Scala. You will work closely with cross-functional teams to...


  • Delhi, Delhi, India Ekfrazo Technologies Full time

    Senior Data Engineer Position:Ekfrazo Technologies is looking for a seasoned Data Engineer to join our team as a Senior Data Engineer. In this role, you will be responsible for leading our fintech data lake project, designing and implementing efficient data ingestion pipelines, and ensuring data consistency and integrity.Responsibilities:Lead...

  • Engineering Manager

    4 weeks ago


    Delhi, Delhi, India PROTEGRITY INDIA PRIVATE LIMITED Full time

    About the RoleProtegrity - Engineering Manager - Big DataProtegrity is a pioneering company in data protection, and we're seeking a seasoned Engineering Manager to lead our Big Data team. This role requires a strategic thinker with expertise in data security and a passion for mentoring and guiding technical teams.Key ResponsibilitiesManage the research and...


  • Delhi, Delhi, India PubMatic Full time

    Job DescriptionWe are seeking a highly skilled Big Data Automation Engineer to join our team at PubMatic. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining automation frameworks for big data workflows.Responsibilities:Designing and implementing automation frameworks using Python to automate big data...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    About the RoleAs a Big Data Solutions Architect, you will be responsible for finalizing the scope of the system and delivering Big Data solutions. This position requires in-depth knowledge of Hadoop, Spark, and similar frameworks.Responsibilities- Lead a team of engineers and have a good attitude toward learning the domain and implementation.- Collaborate...


  • Delhi, Delhi, India LTIMindtree Full time

    We are seeking an experienced Data Engineer to join our team at LTIMindtree. As a key member of our big data solutions group, you will be responsible for designing and developing scalable data platforms using modern technologies like Spark, HBase, Hive, and other Hadoop ecosystem tools.About the RoleIn this role, you will work closely with cross-functional...


  • Delhi, Delhi, India Ekfrazo Technologies Full time

    Role OverviewWe are seeking an experienced Data Engineer to play a crucial role in our fintech data lake project at Ekfrazo Technologies. Technical Requirements :- The ideal candidate will have 7+ years of experience working in data warehousing systems- Strong expertise in Oracle Fusion ecosystem, with strong data-extracting experience using Oracle...


  • Delhi, Delhi, India Sigmoid Full time

    Sigmoid is a cutting-edge company that requires an exceptional leader to drive the development of its big data platform. The ideal candidate will have extensive experience in managing high-performance teams and architecting scalable solutions.**Job Description:**Role Overview:As a Technical Project Manager at Sigmoid, you will lead a team of highly skilled...


  • Delhi, Delhi, India Synechron Full time

    Job Summary">Synechron is seeking an experienced Informatica Big Data Management Lead to join our team in Bangalore. As a key member of our data management team, you will be responsible for leading the design, development, and implementation of big data management solutions using Informatica.">About the Role">We are looking for a highly skilled professional...

  • Cloud Data Engineer

    7 days ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    About the RoleWe are seeking an experienced Cloud Data Engineer to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will play a vital role in designing, building, and deploying big data pipelines in Google Cloud Platform (GCP).Key ResponsibilitiesDesign and develop scalable big data architectures on GCP using...


  • Delhi, Delhi, India Strategic HR Solutions Full time

    Job SummaryWe are looking for an experienced Data Engineer to join our team in Dubai. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Informatica Big Data Management.ResponsibilitiesDesign and build data pipelines using HQL, Hive, and HDFSMaintain and optimize existing systems to...


  • Delhi, Delhi, India Coffeee Full time

    Coffeee is seeking a skilled Hadoop Developer to join our team in Chennai/Bangalore. As a key member of our big data engineering team, you will be responsible for designing, implementing, and supporting Hadoop-based solutions. This role requires strong technical expertise in the Hadoop ecosystem, proficiency in Spark and Scala, and familiarity with...

  • Cloud Data Engineer

    7 days ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Job Role: Cloud Data Engineer - Big Data Solutions SpecialistAbout the Role: Tata Consultancy Services is seeking a skilled Cloud Data Engineer to join our team in Chennai. As a key member of our big data solutions team, you will be responsible for developing and deploying scalable big data pipelines on Google Cloud Platform (GCP).Responsibilities: Develop...

  • Senior Data Engineer

    3 weeks ago


    Delhi, Delhi, India PRONEXUS CONSULTING PRIVATE LIMITED Full time

    **Job Title:** Senior Data Engineer - Big Data Pipeline SpecialistAt Pronexus Consulting Private Limited, we are seeking an experienced and highly skilled Senior Data Engineer - Big Data Pipeline Specialist to join our team. This role will involve designing, developing, and implementing large-scale data pipelines using various technologies such as Spark,...


  • Delhi, Delhi, India NEXUS CONSULTING SOLUTIONS Full time

    We are seeking a skilled Data Engineer to join our team at NEXUS CONSULTING SOLUTIONS. This role requires experience in working with large data sets and a strong understanding of big data systems.Job DescriptionA successful candidate will have hands-on experience in Python and Scala programming languages. Additionally, they should be familiar with the Spark...


  • Delhi, Delhi, India Coders Brain Technology Private Limited Full time

    **Job Title:** Data Engineering LeadCoders Brain Technology Private Limited requires an experienced Data Engineering Lead to develop and maintain complex data pipelines. The successful candidate will have strong knowledge of big data technologies and experience working with large datasets.Key Responsibilities:Leverage AWS services, Spark, Python, AWS Lambda,...


  • Delhi, Delhi, India HCLTech Full time

    About HCLTechWe are a leading global technology company with a strong presence in the IT services industry. Our team of experts is passionate about delivering innovative solutions that drive business growth and success.Job Title: Senior Big Data Engineer - ETL Framework DeveloperLocation: Pan IndiaSalary: ₹ 25,00,000 - ₹ 40,00,000 per annumJob...