Data Engineering Lead

1 week ago


Mumbai, Maharashtra, India The Celeritas AI Full time
Job Description

We are seeking an experienced Data Engineer to lead the development of scalable data processing pipelines at The Celeritas AI.

The ideal candidate will have a strong background in batch and streaming data processing using PySpark, Apache Spark, and related technologies.

  • Key Responsibilities:
  • Design and implement efficient ETL workflows for large-scale data processing
  • Collaborate with cross-functional teams to develop and deploy streaming data pipelines using Kafka and Spark Streaming
  • Develop and maintain automation scripts for CI/CD workflows using tools like Nifi
  • Work closely with data scientists to develop and optimize machine learning models
  • Ensure data quality, security, and compliance throughout the data processing lifecycle
Requirements
  • Technical Skills:
  • 7-8 years of experience with PySpark, Apache Spark, Flink, Nifi, Kafka & other Data Engineering Technologies
  • Strong knowledge of programming languages such as Scala, Java, and Python
  • Experience with Cloudera Tech Stack, like Hive, Impala, HDFS and related tools
Estimated Salary: $120,000 - $180,000 per year
  • Data Engineering Lead

    4 weeks ago


    Mumbai, Maharashtra, India Collabera Full time

    **Collabera Digital is seeking a highly skilled Data Engineering Lead to join our Pune team.**The ideal candidate will have 10+ years of experience in data engineering, with expertise in cloud-based data warehousing platforms, distributed data processing engines, and big data tools.We offer a competitive salary of **₹20-40 lakhs per annum**, depending on...


  • Mumbai, Maharashtra, India Lead School Full time

    Job DescriptionAbout Us:LEAD School is a leading Edtech company in India, committed to making quality education accessible to every child. With over 8,000 schools and 4 million students across the country, we aim to serve 60,000 schools and 25 million students by 2028.Role: General Manager, Category.Purpose of the Job:To achieve 2-3x growth of the brand...


  • Mumbai, Maharashtra, India XHire Full time

    Data Engineer Lead Job SummaryXHire is seeking a highly experienced Senior Data Engineer Lead to join our team. As a key member of our data engineering department, you will be responsible for leading and mentoring a team of data engineers to design, develop, and implement scalable data infrastructure.Job Description:The ideal candidate will have a strong...

  • Data Engineering Lead

    2 months ago


    Mumbai, Maharashtra, India TopHire Full time

    Data Engineering LeadAt TopHire, we are seeking a seasoned Data Engineering Lead to design and develop scalable data pipelines for collecting, processing, and storing healthcare data. As a key member of our team, you will be responsible for architecting and implementing robust data management solutions using cutting-edge technologies like Google Cloud...


  • Mumbai, Maharashtra, India Netscribes Full time

    We are seeking a highly motivated Data Engineering Lead who can drive the success of our data engineering initiatives.The ideal candidate will possess a strong understanding of enterprise architecture and its application in real-world scenarios.Responsibilities:Develop and implement comprehensive architectural designs that leverage cloud-based data...


  • Mumbai, Maharashtra, India VAYUZ Technologies Full time

    Job Summary:VAYUZ Technologies is looking for a Senior Data Engineer Lead to join our data engineering team. The ideal candidate will have a strong background in data integration and governance, with experience leading teams and implementing data pipelines.About the Role:The Senior Data Engineer Lead will be responsible for designing and implementing...


  • Mumbai, Maharashtra, India Colt Data Centre Services Full time

    Job OverviewWe are seeking a highly skilled Lead Electrical Design Manager to join our team at Colt Data Centre Services. This is an exciting opportunity to lead the design of data centre projects, working closely with our delivery teams and stakeholders.About the RoleThe successful candidate will be responsible for leading the electrical design aspects of...

  • IT Support Engineer

    4 weeks ago


    Mumbai, Maharashtra, India NTT DATA Full time

    About the Role",We are seeking a highly skilled IT Support Engineer to join our team at NTT DATA. As an IT Support Engineer, you will be responsible for providing exceptional technical support to our clients, ensuring that their IT infrastructure and systems remain operational.",Key Responsibilities:",",Monitor client infrastructure and solutions to identify...


  • Mumbai, Maharashtra, India Sapphire Management Consultancy Full time

    Job Description:Sapphire Management Consultancy is seeking a highly skilled Data Engineering Lead to join our team. The ideal candidate will have extensive experience in managing data warehouses, data lakes, and operational data stores.The successful candidate will lead the development of robust business cases supported by data, ensuring excellent support...


  • Mumbai, Maharashtra, India Godrej Consumer Products Limited Full time

    Drive Business Growth with Cloud Data EngineeringEstimated Salary: ₹ 25,00,000 - ₹ 35,00,000 per annum.We are seeking a seasoned Cloud Data Engineering Lead to join our team at Godrej Consumer Products Limited. As a key member of our data engineering group, you will be responsible for designing and implementing global data solutions on Azure, leading the...


  • Mumbai, Maharashtra, India Colt Data Centre Services Full time

    About the RoleWe are seeking a seasoned Lead Electrical Design Manager to spearhead our data centre projects. This is an exciting opportunity for a highly skilled professional with a strong background in electrical engineering and design management.Job SummaryThe successful candidate will be responsible for leading the design team, managing project...


  • Mumbai, Maharashtra, India Colt Data Centre Services Full time

    Job DescriptionWe are seeking an experienced Electrical Engineer to join our team as a Design Manager for Data Centre Projects. The ideal candidate will have a strong background in MEP mission critical systems and electrical engineering, with experience in managing multi-disciplinary projects.About the RoleThis is an exciting opportunity to work on...

  • Data Engineer Lead

    2 weeks ago


    Mumbai, Maharashtra, India Olive Trees Consulting Full time

    Job Overview">Olive Trees Consulting is seeking a seasoned Senior Data Engineer to lead the development of our data integration solutions within a cloud environment.">Key Responsibilities">Develop and implement ETL processes to drive business intelligence models and reports.Fuel product data to and performance insights from online platforms for our...


  • Mumbai, Maharashtra, India Searce Inc Full time

    At Searce Inc., we're on a mission to drive intelligent, impactful, and futuristic business outcomes using new-age technology. As a leader in the data engineering domain, you'll be responsible for defining and leading the mission, vision, and strategy for our Data & Analytics Practice.About the RoleWe're seeking a seasoned professional with 10+ years of...


  • Mumbai, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Network Engineer to join our team in NTT DATA, focusing on data center operations. As a key member of our infrastructure team, you will be responsible for ensuring the smooth operation and maintenance of our network infrastructure.Key ResponsibilitiesDesign, implementation, and maintenance of network...


  • Mumbai, Maharashtra, India Revolo Infotech Full time

    Role SummaryWe are seeking an experienced Cloud Data Engineering Lead to join our team at Revolo Infotech. The ideal candidate will have a strong background in designing, developing, and maintaining scalable ETL/ELT pipelines using cloud-based technologies.About the RoleThis role will involve leading cross-functional teams in the development of data...


  • Mumbai, Maharashtra, India Jones RecruitZo Full time

    Job Title: Lead Data Analytics EngineerAbout Us: At Jones RecruitZo, we are committed to delivering innovative solutions that drive business growth.Salary & Benefits:We offer an attractive compensation package of $150,000 - $180,000 per annum, commensurate with experience. This includes a comprehensive benefits plan and opportunities for career...


  • Mumbai, Maharashtra, India Genpact Full time

    Job Description:We are seeking a highly skilled and experienced Data Engineer Lead to join our team at Genpact. This is a critical role that requires strong technical expertise in designing, developing, and implementing large-scale data pipelines.About the Role:The successful candidate will be responsible for leading the development of data ingestion...


  • Mumbai, Maharashtra, India Colt Data Centre Services Full time

    Senior Electrical Engineer Project Design Manager$143,000 - $173,000 per yearAbout Colt Data Centre ServicesWe are a leading provider of data centre services, delivering innovative and cost-effective solutions to our customers. Our team is comprised of experienced professionals who share a passion for excellence and a commitment to providing exceptional...


  • Mumbai, Maharashtra, India Sapphire Management Consultancy Full time

    Job Description:We are seeking an experienced Data Engineering Lead to join our team at Sapphire Management Consultancy. The successful candidate will be responsible for managing and maintaining our Data-Lake and operational data store, as well as improving our Business Intelligence Data mart to facilitate fast and high-end Analytics & Reporting.This role...