Lead Data Engineer

13 hours ago

Gurugram, India Talent Worx Full time

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers. engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative. Requirements Job Summary: As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end. Key Responsibilities: Develop, deploy, and operate data extraction and automation pipelines in production. Integrate and deploy machine learning models into pipelines (e.g., inference services, batch scoring). Lead the delivery of complex extraction, transformation, and ML deployment projects. Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow. Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage. Strengthen data quality and reliability through logging, metrics, and automated alerts. Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines. Technical Requirements: 2-6 years of relevant experience in data engineering, automation, or ML deployment. Expert proficiency in Python, including building extraction libraries and RESTful APIs. Hands-on experience with task queues and orchestration: Celery, Redis, Airflow. Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB. Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred). Proven experience deploying ML models to production. Solid understanding of CI/CD practices and hands-on experience with Azure DevOps. Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)

  • Lead Data Engineer

    3 days ago

    gurugram, India Fabutech Full time

    Years of experience: 8+ yearsMust have Skills:3+ years of hands on experience in Azure Data Engineering development project2+ years of experience in Databricks development2+ years of experience in PySpark.2+ years of experience in SQLProficient in SQL2+ years of experience in leading at least a 5+ member team in data engineering deliveryMust be fluent in...

  • Lead Data Engineer

    3 weeks ago

    Gurugram, Gurugram, India Circle K Full time

    Job Description Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 16,700 stores in 31 countries, serving more than 9 million customers each day. At Circle K, we are building a best-in-class global data engineering practice to support intelligent business...

  • Lead GCP Data Engineer

    3 weeks ago

    Gurugram, Gurugram, India Impetus Full time

    Job Description Job Title: Lead Data Engineer GCP (BigQuery Composer Python PySpark) Location: Gurgaon Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • Azure Data Engineer

    13 hours ago

    Gurugram, India Infogain Full time

    Azure Data Engineer (Lead) with skills Data Engineering, Python, Apache Hadoop, Apache Hive, Apache Airflow, synapse, databricks, SQL, Apache Spark, Azure Data Factory, Pyspark, GenAI Fundamentals, Cloud Pub/Sub, BigQuery for location Gurugram, India Posted on: November 12, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Key...

  • Data Engineer Lead

    1 week ago

    Bengaluru, Gurugram, India Metyis Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Metyis is a Netherlands based fast-growing international company with a diverse team of over 700+ professionals with a mix of Analytics, Data Science and Technology Team.We are looking for an experienced Data Engineer to join our team with below requirements:Responsibilities:Independently lead & manage execution of data engineering projectsEngineer complete...

  • Lead Data Engineer

    3 weeks ago

    Gurugram, India Techno Wise Full time

    Senior Azure Data Engineer (Team Lead)Location : Gurgaon (Work from Office 5 Days a Week)Experience Required : 8+ YearsJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team in Gurgaon. This is a full-time, on-site role requiring a professional with a strong background in Azure Data Engineering, Databricks,...

  • Lead Data Engineer

    1 week ago

    Gurugram, India Oliver Wyman Full time

    Job Description - Working alongside Oliver Wyman consulting teams and partners, engaging directly with clients to understand their business challenges - Exploring large-scale data anddesigning, developing, and maintaining data/software pipelines, and ETL processesfor internal and external stakeholders - Explaining, refining, and developing the necessary...

  • Data Engineering Lead

    7 days ago

    Gurugram, India People Connect Consultants Full time

    Description : Were looking for a Data Engineer - Lead to shape and scale our data engineering function. In this role, you will lead a high-performing team, define technical strategy, and architect enterprise-scale data platforms. Youll collaborate with senior leadership, drive cross-functional data initiatives, and ensure excellence in building scalable,...

  • Data Engineer/Lead

    7 days ago

    Gurugram, India WMGO Full time

    Job Description :At Our Client, we are seeking a Data Engineer - Lead to architect and scale enterprise-grade data platforms, manage and mentor a growing team, and drive the design and implementation of high-performance, cloud-native data solutions that power advanced analytics and AI initiatives.Requirements : - 7+ years of experience in data engineering,...

  • Senior Tableau Data Consultant

    3 weeks ago

    Gurugram, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions. The candidate is expected to lead the following work-streams:  Partner...