Lead AI Data Engineer

3 days ago

Gurgaon, Haryana, India S&P Global Market Intelligence Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Summary:

As a Data Engineer & AI Developer, you will play a key role in transforming complex data into clear, actionable insights. You will be responsible for building robust data pipelines, developing interactive dashboards, and integrating cutting-edge AI techniques to enhance our data processes and insights. This is a unique opportunity to blend expertise in data engineering and visualization with a forward-thinking approach to artificial intelligence.

Key Responsibilities:

  • ETL/ELT Development: Design, build, and optimize scalable data pipelines using ETL/ELT processes to ingest, clean, and transform large datasets from various sources.
  • AI-Powered Data Engineering: Implement and manage AI-driven ETL processes that use machine learning models for data quality checks, anomaly detection, and automated data transformation.
  • Advanced Data Processing: Utilize Python and Apache Spark on the Databricks platform to perform large-scale data processing and feature engineering. Leverage tools like Delta Lake for efficient and reliable data management.
  • Multi-Cloud Infrastructure: Architect and manage data solutions within the AWS and Azure ecosystem, leveraging services like S3 or ADLS for storage.
  • AI/ML Integration: Work with data scientists to integrate machine learning models into production pipelines, ensuring data is prepared and delivered for model training and inference.
  • Automated Workflows & Agentic CI/CD: Implement and maintain CI/CD pipelines using GitHub Actions, with a focus on creating agentic CI/CD workflows that automate tasks, trigger model retraining, or deploy data services based on dynamic triggers or data changes.
  • Database Management: Write complex SQL queries and apply strong knowledge of database and data warehousing concepts to design and optimize data schemas.
  • Software Engineering Principles: Adhere to best practices in software development, including writing clean, well-documented code, conducting code reviews, and designing for scalability and maintainability.

Required Skills:

  • Proven experience in building and managing large-scale data pipelines.
  • Strong proficiency in Python, including libraries like Pandas, NumPy, and PySpark.
  • Hands-on expertise with Databricks and Apache Spark.
  • Solid understanding of AWS services relevant to data engineering (S3, Glue, EMR).
  • Solid understanding of Azure services relevant to data engineering (Data Lake, Azure HDInsight, Data Factory)
  • Experience with GitHub and developing robust CI/CD pipelines.
  • Proficiency in SQL and knowledge of relational and NoSQL databases.
  • A strong foundation in software engineering principles.

AI Skills (Highly Desired):

  • Experience with machine learning frameworks (e.g., scikit-learn, TensorFlow, PyTorch).
  • Knowledge of AI/ML applications in data engineering, such as using models for data quality or feature selection.
  • Familiarity with agentic systems and the ability to build agentic CI/CD pipelines that automate complex, multi-step processes.
  • Experience with data governance and explainability in AI/ML pipelines.

  • AI Engineer

    1 day ago

    Gurgaon, Haryana, India Weekday AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role is for one of the Weekday's clientsMin Experience: 4 yearsLocation: Gurgaon, NCRJobType: full-timeWe are seeking a highly skilled and innovative AI Engineer with 4–8 years of hands-on experience in artificial intelligence, machine learning, and deep learning. This role requires a professional who can design, build, and deploy AI-driven solutions...

  • AI Engineer Data Scientist Sales and Marketing

    1 week ago

    Gurgaon, Haryana, India Quara Ai Tech Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: AI Engineer / Data Scientist Sales & Marketing About the RoleWe are seeking a highly skilled AI Engineer / Data Scientist to join our team and be part of the innovation at the intersection of sales, marketing, and advanced intelligence and analytics. The ideal candidate will leverage machine learning, generative AI, and data science techniques to...

  • Senior AI Engineer

    3 weeks ago

    Gurgaon, Haryana, India NextDimension AI Full time

    Job DescriptionNextDimensionis seeking a passionate and experienced Senior AI Engineer to join our core mission. We are a team of distinguished AI/ML Scientists and Engineers fromGoogle, Amazon, and Snowflake, dedicated to building the next generation of AI Agents that empower Small and Medium Enterprises (SMEs). As part of this team, you will collaborate...

  • Lead Software/Data Engineer

    1 day ago

    Gurgaon, Haryana, India CoPoint AI Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Title:Senior Software/Data EngineerExperience7 - 9 yearsAbout CoPoint DataCoPoint Datais a consulting and technology solutions company that helps organizations transform how they operate, grow, and make decisions—through the intelligent use of data, AI, and automation. We specialize in combiningmodern engineering,cloud-native platforms, andAI-first...

  • Lead AI Engineer

    1 day ago

    Gurgaon, Haryana, India Mercer Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description: As a Lead AI Engineer, you will be at the forefront of our AI-driven transformation, shaping the future of intelligent solutions within our organization. You will champion best practices in AI development, foster innovation, and serve as a technical leader guiding teams to deliver impactful AI-powered products. This role requires a hands-on...

  • Lead AI Engineer

    1 day ago

    Gurgaon, Haryana, India Simpplr Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    Who We AreSimpplr is the AI-powered platform that unifies the digital workplace – bringing together engagement, enablement, and services to transform the employee experience. It streamlines communication, simplifies interactions, automates workflows, and elevates the everyday experience of work. The platform is intuitive, highly extensible, and built to...

  • Lead AI Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Jobs via eFinancialCareers Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    *About the Role:Grade Level (for internal use):*11Summary:As a Data Engineer & AI Developer, you will play a key role in transforming complex data into clear, actionable insights. You will be responsible for building robust data pipelines, developing interactive dashboards, and integrating cutting-edge AI techniques to enhance our data processes and...

  • Engineer - Gen AI

    3 days ago

    Gurgaon, Haryana, India Intersoft Data Labs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking an experienced Generative AI professional with expertise in designing and deploying Large Language Models (LLMs) from scratch as well as fine-tuning and optimizing existing models. The role requires deep technical skills, creativity, and hands-on experience in building scalable GenAI solutions across text, image, and multimodal domains.Key...

  • Principal /Lead AI Engineer

    1 day ago

    Gurgaon, Haryana, India Simpplr Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    Who We AreSimpplr is the AI-powered platform that unifies the digital workplace – bringing together engagement, enablement, and services to transform the employee experience. It streamlines communication, simplifies interactions, automates workflows, and elevates the everyday experience of work. The platform is intuitive, highly extensible, and built to...

  • Lead Gen AI Engineer

    2 weeks ago

    Gurgaon, Haryana, India Cvent Full time

    Job DescriptionSenior Business Analytics Engineer (AI & Data Analytics)Looking for an experienced Business Analytics Engineer (7-8 years) with strong expertise in Python, SQL, and Tableau to support our Sales & Marketing teams. The ideal candidate will have a proven ability to leverage and build AI-driven data models for research and structured database...