Lead Data Engineer

3 weeks ago

Gurugram, India Talent Worx Full time

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.

engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.

Requirements

Job Summary:

As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end.

Key Responsibilities:

  • Develop, deploy, and operate data extraction and automation pipelines in production.
  • Integrate and deploy machine learning models into pipelines (e.g., inference services, batch scoring).
  • Lead the delivery of complex extraction, transformation, and ML deployment projects.
  • Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow.
  • Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage.
  • Strengthen data quality and reliability through logging, metrics, and automated alerts.
  • Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines.

Technical Requirements:

  • 2-6 years of relevant experience in data engineering, automation, or ML deployment.
  • Expert proficiency in Python, including building extraction libraries and RESTful APIs.
  • Hands-on experience with task queues and orchestration: Celery, Redis, Airflow.
  • Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB.
  • Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred).
  • Proven experience deploying ML models to production.
  • Solid understanding of CI/CD practices and hands-on experience with Azure DevOps.
  • Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)

  • Lead/Principal Data Consultant

    4 weeks ago

    Gurugram, Gurugram, India Eucloid Data Solutions Full time

    Job Description Key Responsibilities: - Drive the definition, design and delivery of new data products within the customer's Data Platform and related applications, reporting directly to the Director. Create product strategy documents/PRDs that describe business cases, high-level use cases, technical requirements and ROI Develop, update and implement...

  • Data Engineering Lead

    3 weeks ago

    Gurugram, India Metyis Full time

    What we offer Interact with C-level at our clients on regular basis to drive their business towards impactful change.  Lead your team in creating new business solutions.  Seize opportunities at the client and at Metyis in our entrepreneurial environment.  Become part of a fast-growing international and diverse team. What you will do Independently...

  • Data Engineer Advisor

    3 weeks ago

    Gurugram, India NTT DATA Services Full time

    Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide...

  • Data Engineer Advisor

    3 weeks ago

    Gurugram, India NTT DATA Services Full time

    Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide L1, L2...

  • Lead Engineer, Data Migration

    3 weeks ago

    Gurugram, India MongoDB Full time

    MongoDB’s mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB...

  • Lead Engineer, Data Migration

    3 weeks ago

    Gurugram, India MongoDB Full time

    MongoDB’s mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB...

  • Data Engineer Lead

    1 week ago

    Bengaluru, Gurugram, India Metyis Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Metyis is a Netherlands based fast-growing international company with a diverse team of over 700+ professionals with a mix of Analytics, Data Science and Technology Team.We are looking for an experienced Data Engineer to join our team with below requirements:Responsibilities:Independently lead & manage execution of data engineering projectsEngineer complete...

  • Lead Data Engineer

    2 days ago

    Gurugram, India Techno Wise Full time

    Senior Azure Data Engineer (Team Lead)Location : Gurgaon (Work from Office 5 Days a Week)Experience Required : 8+ YearsJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team in Gurgaon. This is a full-time, on-site role requiring a professional with a strong background in Azure Data Engineering, Databricks,...

  • Data Engineer/Lead

    3 weeks ago

    Gurugram, India WMGO Full time

    Job Description :At Our Client, we are seeking a Data Engineer - Lead to architect and scale enterprise-grade data platforms, manage and mentor a growing team, and drive the design and implementation of high-performance, cloud-native data solutions that power advanced analytics and AI initiatives.Requirements : - 7+ years of experience in data engineering,...

  • Senior Data Engineering Lead

    3 weeks ago

    Gurugram, India Workassist Full time

    Description : Position : Senior Data Engineering Team Leader (Azure Focus)Work Level : Senior LeadershipIndustry Type : IT Services & ConsultingJob Summary : We are seeking a Disciplined and innovation-focused Senior Data Engineering Team Leader to lead a team in designing and implementing advanced data solutions on the Microsoft Azure cloud platform. This...