Principal AI Evaluation Engineer

4 days ago

New Delhi, India Backbase Full time

The Job in short As a aPrincipal AI Evaluation Engineeryou will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and reporting, and make evaluation a cornerstone of release decisions.Meet the job ● Define and lead the evaluation strategy and roadmap for AI-powered SDLC core product ● Build and oversee evaluation pipelines and guardrails. ● Build and maintain evaluation datasets (synthetic and real project data) to benchmark AI behavior. ● Analyze evaluation results, identify gaps, and produce clear, actionable reports for engineering and product stakeholders. ● Build a culture of innovation and excellence, encouraging continuous improvement and adoption of best practices in AI evaluation and deployment. ● Collaborate with cross-functional teams to integrate evaluation insights into development.How about you ● Strong understanding of software engineering principles and the software development lifecycle (SDLC). ● Hands-on experience with test design, test management, observability, and data analysis. ● Proficiency in Python (or another scripting language) for automating evaluations. ● Familiarity with AI Agent evaluation methods (faithfulness, answer relevancy, contextual accuracy, tool correctness). ● Excellent analytical and problem-solving skills. ● Strong communication and collaboration abilities, able to work with cross-functional teams and stakeholders.

  • Principal AI Engineer

    3 weeks ago

    New Delhi, India Backbase Full time

    What We’re Looking ForWe’re looking for a Principal AI Engineer with a passion for building intelligent, context-aware agentic systems. You’ll help shape the core of our Agentic AI Automation Platform that orchestrates and automates complex agentic workflows to deliver measurable outcomes for global banks.Meet the job- Backbase has ushered in a new era...

  • Principal RTL Engineer

    4 weeks ago

    New Delhi, India Mulya Technologies Full time

    Principal RTL Engineer (AI & Multimedia ) Founded by highly respected Silicon Valley veterans - with its design centers established in Santa Clara, California. / Hyderabad/ BangaloreOur pay comprehensively beats "ALL" Semiconductor product players in the Indian market.We are seeking a highly skilled Principal RTL Engineer with strong expertise in VLSI...

  • TinyML / Embedded AI Principal Engineer

    2 days ago

    New Delhi, India L&T Technology Services Full time

    Position Title: TinyML / Embedded AI Principal EngineerLocation: BangaloreExperience Required: 15+ YearsEmployment Type: Full-TimeRole Purpose:The TinyML / Embedded AI Principal Engineer will lead the design, development, optimization, and deployment of AI solutions on edge and resource-constrained embedded devices. This role is critical to enabling...

  • Principal Machine Learning Engineer

    3 weeks ago

    New Delhi, India Informatica Full time

    Principal Machine Learning EngineerInformatica is on a journey to leverage generative AI to simplify cloud data management. Principal Machine Learning Engineer will be responsible for driving the overall architecture and pipelines to enable Machine Learning engineers to build, train and deploy Models at scale across multiple cloud services providers in a...

  • TinyML / Embedded AI Principal Engineer

    4 days ago

    New Delhi, India L&T Technology Services Full time

    Position Title:TinyML / Embedded AI Principal Engineer Location:Bangalore Experience Required:15+ Years Employment Type:Full-Time Role Purpose: The TinyML / Embedded AI Principal Engineer will lead the design, development, optimization, and deployment of AI solutions on edge and resource-constrained embedded devices. This role is critical to enabling...

  • Generative AI Engineer

    4 weeks ago

    New Delhi, India Vsynergize AI Full time

    We are looking for a talented and driven AI Engineer with a strong foundation in Python, Natural Language Processing, and experience working with Large Language Models (LLMs). This is an exciting opportunity to be at the forefront of AI development, working on real-world problems involving cutting-edge technologies such as prompt engineering, cloud-based...

  • Principal LLM Engineer

    4 weeks ago

    New Delhi, India Rapid7 Full time

    Principal LLM EngineerJoin Rapid7: Secure the Future with AIAre you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products?Rapid7 is looking for a Principal LLM Engineer with a rare combination of deep Data Science expertise, mastery of production MLOps, and 13+ years of experience. You...

  • Principal Architect

    4 weeks ago

    New Delhi, India Movate Full time

    Job title: Principal AI ArchitectLocation: Bangalore / Hyderabad / ChennaiExperience: 12 to 15 YearsSummary:We are seeking a highly experienced Principal AI Architect to lead the design, development, and deployment of cutting-edge AI solutions with a strong focus on Generative AI (GenAI), Agentic AI frameworks, and Python-based development. The ideal...

  • Principal Software Engineer

    4 days ago

    New Delhi, India Informatica Full time

    Build Your Career at InformaticaWe seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous, work-from-anywhere minds eager to solve the world's most complex challenges. Our employees are empowered to push their bold ideas forward, and we are united by a shared passion for using data to do...

  • Generative AI Engineer

    3 weeks ago

    New Delhi, India Utkast AI Full time

    At Utkast AI, we’re changing how people work.We believe the future of work isn’t about doing more — it’s about doing less of what doesn’t matter.The endless admin, the meeting notes, the follow-ups, the email threads — that’s not the real work.The real work is thinking, creating, connecting, and leading.Utkast exists to remove the boring middle...