Lead Data Engineer

21 hours ago

Gurugram, India Talent Worx Full time

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.

engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.

Requirements

Job Summary:

As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end.

Key Responsibilities:

  • Develop, deploy, and operate data extraction and automation pipelines in production.
  • Integrate and deploy machine learning models into pipelines (e.g., inference services, batch scoring).
  • Lead the delivery of complex extraction, transformation, and ML deployment projects.
  • Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow.
  • Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage.
  • Strengthen data quality and reliability through logging, metrics, and automated alerts.
  • Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines.

Technical Requirements:

  • 2-6 years of relevant experience in data engineering, automation, or ML deployment.
  • Expert proficiency in Python, including building extraction libraries and RESTful APIs.
  • Hands-on experience with task queues and orchestration: Celery, Redis, Airflow.
  • Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB.
  • Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred).
  • Proven experience deploying ML models to production.
  • Solid understanding of CI/CD practices and hands-on experience with Azure DevOps.
  • Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)

  • Lead/Principal Data Consultant

    5 days ago

    Gurugram, Gurugram, India Eucloid Data Solutions Full time

    Job Description Key Responsibilities: - Drive the definition, design and delivery of new data products within the customer's Data Platform and related applications, reporting directly to the Director. Create product strategy documents/PRDs that describe business cases, high-level use cases, technical requirements and ROI Develop, update and implement...

  • Lead Data Engineer

    2 weeks ago

    Gurugram, India Vipsa Talent Solutions Full time

    • Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production data platform

  • Principal Software/Data Engineering

    2 weeks ago

    Gurugram, India CoPoint Data Full time

    About CoPoint Data CoPoint Data is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients....

  • Data Engineering Lead

    1 day ago

    Gurugram, India Metyis Full time

    What we offer Interact with C-level at our clients on regular basis to drive their business towards impactful change.  Lead your team in creating new business solutions.  Seize opportunities at the client and at Metyis in our entrepreneurial environment.  Become part of a fast-growing international and diverse team. What you will do Independently...

  • Lead Data Engineer

    2 weeks ago

    Gurugram, India WOW Softech Full time

    Exp- 8-15 years 3+ years of hands on experience in Azure Data Engineering development project 2+ years of experience in Databricks development 2+ years of experience in PySpark. 2+ years of experience in SQL Proficient in SQL 2+ years of experience in leading at least a 5+ member team in data engineering delivery Must be fluent in communication Role &...

  • Lead Data Engineer

    2 weeks ago

    Gurugram, India CBRE Full time

    Gurgaon - Haryana - India, Hyderabad - Telangana - India, Noida - Uttar Pradesh - India About The RoleAs a Senior Lead Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipeline and infrastructure. You will work closely with stakeholders, analysts, and other to ensure data integrity, availability, and security. This...

  • Senior Web Developer and Data Engineer

    2 weeks ago

    Gurugram, India CoPoint Data Full time

    About CoPoint AI CoPoint AI is a specialized consulting firm focused on transforming businesses through process improvement, data insights, and technology-driven innovation. We leverage AI technologies, Microsoft cloud platforms, and modern web development frameworks to deliver intelligent, scalable solutions that drive measurable impact for our clients. Our...

  • Data Engineer Advisor

    1 day ago

    Gurugram, India NTT DATA Services Full time

    Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide L1, L2...

  • Data Engineer Advisor

    20 hours ago

    Gurugram, India NTT DATA Services Full time

    Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryāna (IN-HR), India (IN). Technical Support: Provide...

  • Lead Engineer, Data Migration

    1 day ago

    Gurugram, India MongoDB Full time

    MongoDB’s mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB...