Lead Data Engineer

3 days ago

Gurgaon, Haryana, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.

engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.

Requirements

Job Summary:

As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end.

Key Responsibilities:

  • Develop, deploy, and operate data extraction and automation pipelines in production.
  • Integrate and deploy machine learning models into pipelines (e.g., inference services, batch scoring).
  • Lead the delivery of complex extraction, transformation, and ML deployment projects.
  • Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow.
  • Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage.
  • Strengthen data quality and reliability through logging, metrics, and automated alerts.
  • Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines.

Technical Requirements:

  • 2-6 years of relevant experience in data engineering, automation, or ML deployment.
  • Expert proficiency in Python, including building extraction libraries and RESTful APIs.
  • Hands-on experience with task queues and orchestration: Celery, Redis, Airflow.
  • Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB.
  • Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred).
  • Proven experience deploying ML models to production.
  • Solid understanding of CI/CD practices and hands-on experience with Azure DevOps.
  • Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)

  • Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India Metyis Full time

    Job DescriptionWho We AreThe next step of your career starts here, where you can bring your own unique mix of skills and perspectives to a fast-growing team.Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering AI & Data, Digital Commerce, Marketing & Design solutions and Advisory services. At...

  • Eucloid - Lead - Data Consultant

    3 weeks ago

    Gurgaon, Haryana, India Eucloid Data Solutions Pvt Ltd Full time

    Job description:We are looking for a high-energy individual for the role of Lead Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in Marketing Analytics vertical. The candidate is expected to lead following work-streams:- Identifying opportunities and influencing partners to act: You will partner with...

  • Lead Data Infrastructure Engineer

    1 day ago

    Gurgaon, Haryana, India beBeeJavaDeveloper Full time

    What you will be doingWe are looking for a highly motivated and experienced Java Developer to design, develop, and optimize our data infrastructure and pipelines. The ideal candidate will have a deep understanding of Java development on Cloud environments.Job Description:We need someone who can provide services to the Market Risk Management function of an...

  • Lead Engineer

    3 weeks ago

    Gurgaon, Haryana, India MNR Solutions Full time

    Job Description :We are seeking a highly motivated Lead Engineer Business Analyst with strong analytical skills and a passion for data-driven decision-making. This is a high-impact role ideal for recent graduates or professionals with up to 1 year of experience looking to build a career in business analytics, product strategy, or growth.Key Responsibilities...

  • 3 Days Left: Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India United Airlines Full time

    Job DescriptionAchieving our goals starts with supporting yours. Grow your career, access top-tier health and wellness benefits, build lasting connections with your team and our customers, and travel the world using our extensive route network.Come join us to create whats next. Lets define tomorrow, together.DescriptionDescription - ExternalUnited&aposs...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Sureminds Solutions Full time

    Job Description : Data Engineer Python + AWS + AIExp Level : 5 to 8 yearsLocation : Gurgaon & RemoteInterview Process : Assessment OR 1st Technical interview , 2 - Client interview , 1 HR Round.Role Overview : Lead design and delivery of LLM-powered, agentic AI solutions with robust RAG pipelines and prompt-engineering best practices.Key Responsibilities :-...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Mercer Full time

    Job DescriptionRole Responsibilities:- Design, develop, and maintain data/software pipelines and ETL processes.- Advocate best practices in data engineering, code hygiene, and code reviews.- Lead the development of proprietary data engineering and analytical tools.- Travel to client locations as needed to deliver solutions.Job Requirements:- Bachelor's or...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Boston Consulting Group Full time

    *Locations*: Bengaluru | GurgaonWho We AreBoston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling...

  • Data engineer

    16 hours ago

    Gurgaon, Haryana, India Boston Consulting Group Full time

    *Locations*: Bengaluru | GurgaonWho We AreBoston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling...

  • Global Data Engineering Innovation Leader

    9 hours ago

    Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Data Engineering ManagerWe are seeking a highly skilled Data Engineering Manager to lead our data engineering efforts and drive strategic impact. As a key member of our team, you will play a critical role in designing, developing, and optimizing scalable data pipelines and infrastructure that enable seamless access to high-quality, actionable insights.About...