Principal AI Evaluation Engineer

2 days ago

Hyderabad, Telangana, India Backbase Full time ₹ 12,00,000 - ₹ 24,00,000 per year


About Backbase

As a a Principal AI Evaluation Engineeryou will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and reporting, and make evaluation a cornerstone of release decisions.

Meet the job

  • Define and lead the evaluation strategy and roadmap for AI-powered SDLC core product

  • Build and oversee evaluation pipelines and guardrails.

  • Build and maintain evaluation datasets (synthetic and real project data) to benchmark AI behavior.

  • Analyze evaluation results, identify gaps, and produce clear, actionable reports for engineering and product stakeholders.

  • Build a culture of innovation and excellence, encouraging continuous improvement and adoption of best practices in AI evaluation and deployment.

  • Collaborate with cross-functional teams to integrate evaluation insights into development.

How about you?

  • Strong understanding of software engineering principles and the software development lifecycle (SDLC).

  • Hands-on experience with test design, test management, observability, and data analysis.

  • Proficiency in Python (or another scripting language) for automating evaluations.

  • Familiarity with AI Agent evaluation methods (faithfulness, answer relevancy, contextual accuracy, tool correctness).

  • Excellent analytical and problem-solving skills.

  • Strong communication and collaboration abilities, able to work with cross-functional teams and stakeholders.

  • Demonstrated ability to mentor engineering talent, fostering collaboration and technical excellence.

  • (Nice to have) Experience with evaluation frameworks, RAG systems, or agentic workflows.

  • Principal AI Engineer

    7 days ago

    Hyderabad, Telangana, India Backbase Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    What We're Looking ForWe're looking for aPrincipal AI Engineerwith a passion for building intelligent, context-aware agentic systems. You'll help shape the core of our Agentic AI Automation Platform that orchestrates and automates complex agentic workflows to deliver measurable outcomes for global banks.Meet the jobBackbase has ushered in a new era of...

  • Principal AI Engineer

    2 days ago

    Hyderabad, Telangana, India Nucoro (acquired by Backbase) Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    See all jobsPrincipal AI EngineerHyderabad - EcosystemHybridBackbase has ushered in a new era of digital banking with the global launch of its AI-powered Banking Platform, recently lighting up Times Square. This milestone marks a bold step in reshaping the digital banking landscape—empowering banks to move beyond generative AI experiments and into...

  • Principal AI Engineer

    3 weeks ago

    Hyderabad, Telangana, India, Telangana Backbase Full time

    What We’re Looking ForWe’re looking for a Principal AI Engineer with a passion for building intelligent, context-aware agentic systems. You’ll help shape the core of our Agentic AI Automation Platform that orchestrates and automates complex agentic workflows to deliver measurable outcomes for global banks.Meet the jobBackbase has ushered in a new era...

  • Principal Applied AI Engineer

    1 day ago

    Hyderabad, Telangana, India Microsoft Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Principal Applied AI EngineerHyderabad, Telangana, IndiaDate postedOct 28, 2025Job number1903082Work site3 days / week in-officeTravel0-25%Role typeIndividual ContributorProfessionResearch, Applied, & Data SciencesDisciplineApplied SciencesEmployment typeFull-TimeOverviewSecurity represents the most critical priorities for our customers in a world awash in...

  • Principal/Senior AI Engineer

    7 days ago

    Hyderabad, Telangana, India YO IT CONSULTING Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description :Title : Principal/ Senior AI Engineer- Graph Data ScienceExperience : 4 to 7 yearsLocation : HyderabadMust Haves :AI/Machine Learning/Neural NetworkRole And Responsibilities : We are seeking a highly skilled Principal/Senior AI Engineer Graph Data Science to join our advanced analytics and AI team. The ideal candidate will have strong...

  • Lead Principal AI

    2 weeks ago

    Hyderabad, Telangana, India Cornerstone OnDemand Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We're looking for aLead Principal AIThis role is Office Based, Hyderabad OfficeWe're looking for a highly experienced and innovative Lead Principal Data Scientist to drive the development and adoption of our LLM Platform and Generative AI initiatives. In this pivotal role, you'll be instrumental in shaping our AI strategy, architecting scalable solutions,...

  • AI Engineer

    1 day ago

    Hyderabad, Telangana, India Evrything AI Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionEvrything AI is an all-in-one AI assistant designed to handle your everyday tasks such as bookings, emails, schedules, online orders, reminders, and more. It aims to be your go-to personal AI, making managing your life seamless and efficient. Built to assist with literally everything, Evrything AI is poised to enhance productivity and...

  • AI Systems Prompt Engineer

    7 days ago

    Hyderabad, Telangana, India Deep AI OCR Full time

    Company DescriptionDeep AI OCR is an "AI First" company that aims to reimagine document processing in organizations by leveraging advanced AI LLMs. We provide efficient and accurate AI-powered optical character recognition solutions that enhance productivity for businesses of all sizes. Our solutions generate 70% of the code using AI, and our trained Agentic...

  • Principal Engineer

    4 days ago

    Hyderabad, Telangana, India GrowthAXL Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Principal Engineer – Service Now – Now Assist AI AgentsRoleJob DescriptionPrincipal Engineer for ServiceNow focusing on Now Assist AI AgentsLead the development of modern Service Management and Automation solutions,primarily in HealthcareDesign, develop, and own AI agent platform components, including promptengineering, integrations, and workflowsAct as...

  • AI Engineer

    1 week ago

    Hyderabad, Telangana, India Deccan AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Location:Hyderabad (On-site/Hybrid)Company:Deccan AIEmployment Type:Full-TimeExperience:1–3 YearsAbout Deccan AIDeccan AI is at the forefront of building advanced AI solutions for real-world applications. We're passionate about pushing the boundaries of artificial intelligence, natural language processing, and intelligent agent systems. Join us and work...