Principal AI Evaluation Engineer
3 weeks ago
The Job in short As a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and reporting, and make evaluation a cornerstone of release decisions. Meet the job ● Define and lead the evaluation strategy and roadmap for AI-powered SDLC core product ● Build and oversee evaluation pipelines and guardrails. ● Build and maintain evaluation datasets (synthetic and real project data) to benchmark AI behavior. ● Analyze evaluation results, identify gaps, and produce clear, actionable reports for engineering and product stakeholders. ● Build a culture of innovation and excellence, encouraging continuous improvement and adoption of best practices in AI evaluation and deployment. ● Collaborate with cross-functional teams to integrate evaluation insights into development. How about you ● Strong understanding of software engineering principles and the software development lifecycle (SDLC). ● Hands-on experience with test design, test management, observability, and data analysis. ● Proficiency in Python (or another scripting language) for automating evaluations. ● Familiarity with AI Agent evaluation methods (faithfulness, answer relevancy, contextual accuracy, tool correctness). ● Excellent analytical and problem-solving skills. ● Strong communication and collaboration abilities, able to work with cross-functional teams and stakeholders.
-
Principal AI Evaluation Engineer
4 weeks ago
Hyderabad, India Backbase Full timeThe Job in shortAs a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal AI Evaluation Engineer
4 weeks ago
Hyderabad, India Backbase Full timeThe Job in shortAs a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal AI Evaluation Engineer
4 weeks ago
hyderabad, India Backbase Full timeThe Job in short As a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal AI Evaluation Engineer
6 days ago
Hyderabad, India Backbase Full timeThe Job in short As a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal AI Evaluation Engineer
6 days ago
Hyderabad, India Backbase Full timeThe Job in shortAs a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal AI Evaluation Engineer
7 days ago
hyderabad, India Backbase Full timeThe Job in shortAs a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal AI Evaluation Engineer
2 weeks ago
Hyderabad, Telangana, India Backbase Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout BackbaseAs a a Principal AI Evaluation Engineeryou will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and reporting,...
-
Principal AI Evaluation Engineer
4 weeks ago
Hyderabad, India Backbase Full timeThe Job in short As a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
AI Evaluation Technical Lead
3 weeks ago
Hyderabad, India Backbase Full timeThe Job in shortAs a a Principal AI Evaluation Engineer you will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and...
-
Principal Software Engineer
2 weeks ago
Hyderabad, India Cornerstone OnDemand Full timeWe're looking for a Principal Software Engineer - AI This role is Office Based, Hyderabad Office We’re looking for a curious, motivated Principal Software Engineer AI to join our team and help build the nextgeneration of intelligent talent technology. This is a hands-on opportunity to learn how AI and machine learning are developed and deployed in a...
