Technical Program Manager AI Evaluation

1 day ago

Hyderabad, Telangana, India Virtusa Full time

Role Overview

  • We are seeking a highly skilled Technical Program Manager (TPM) to lead an AI evaluation and automation program focused on dataset development, model assessment, and toolchain integration for Googles AI products (e g , Gemini CLI, Code Review Agent)
  • This role will drive governance, stakeholder alignment, and delivery excellence across multi-disciplinary engineering teams

Key Responsibilities

  • Own end-to-end program governance, including planning, execution, and reporting of AI evaluation workstreams.
  • Translate Googles evaluation and labeling guidelines into operational execution plans and success metrics.
  • Manage cross-functional alignment between AI engineers, raters, and automation teams.
  • Define KPIs and ensure timely delivery of datasets, evaluation pipelines, and benchmarking reports.
  • Lead risk, dependency, and quality management across distributed teams.
  • Present progress, insights, and recommendations to Google stakeholders and leadership.
  • Ensure compliance with data handling, labeling, and security policies.

Required Skills & Experience

  • 8-12 years of experience in technical program or product management, preferably in AI/ML or data-driven environments.
  • Deep understanding of machine learning evaluation processes, LLM workflows, and automation tools.
  • Proven experience managing cross-geography teams and agile delivery models.
  • Proficiency with Google AI ecosystem tools (Vertex AI, Gemini CLI, BigQuery, Looker).
  • Excellent communication, stakeholder management, and documentation skills.
  • Familiarity with Git-based systems (GitHub, GitLab, Bitbucket).

Preferred Qualifications

  • Experience managing AI evaluation or model benchmarking programs.
  • Background in software engineering or data science.
  • PMP or Agile certification preferred.

  • AI Evaluation

    1 week ago

    Hyderabad, Telangana, India Virtusa Full time

    AI Evaluation & Data Engineering Specialist Role OverviewWe are looking for AI Evaluation & Data Engineering Specialists to design, curate, and operationalize datasets and evaluation frameworks for AI product performance assessment. This role involves working with large language models (LLMs), human raters, and automation tools to measure model accuracy,...

  • Technical Program Manager

    1 day ago

    Hyderabad, Telangana, India TechStar Group Full time

    Technical Program Manager / Senior Delivery Manager – Data & AI PlatformsLocation:HyderabadOrganization:TechStar GroupLevel:Senior Delivery ManagerRole SummaryTechStar Group is seeking aTechnical Program Manager / Senior Delivery Managerto lead large-scaleData & AI platform initiativesand manage a diverse pool of over150+ technical resourcesacross...

  • Technical Program Manager

    2 weeks ago

    Hyderabad, Telangana, India Teradata Full time

    Our CompanyAt Teradata, we believe that people thrive when empowered with better information. That's why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers' customers—to make better, more confident decisions. The...

  • Technical Trainer

    3 days ago

    Hyderabad, Telangana, India Deccan AI Full time

    Job Title: Technical TrainerExperience: 2+ yearsAbout Deccan AIDeccan AI is a model training and eval startup headquartered in the Bay Area. We are founded by IIT Bombay, IIM Ahmedabad and ex-Google alumni, and work with some of the top AI frontier labs in the world, e.g. Google Deepmind, Snowflake, and many more. We are backed by Prosus Ventures, and our...

  • Principal AI Evaluation Engineer

    2 weeks ago

    Hyderabad, Telangana, India Backbase Full time

    About BackbaseAs a a Principal AI Evaluation Engineeryou will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and reporting,...

  • Sr Staff Technical Program manager

    7 days ago

    Hyderabad, Telangana, India GE Vernova Full time

    Job Description SummaryThis is an exciting new role within the System Technology and Adaptive Intelligence (STAI) team in Gas Power Engineering (GPE), whose organizational vision is to create "an artificial intelligence enhanced electric power and CO₂-focused innovation team that supports and incubates new ventures and ideas through diligent engineering to...

  • AI Trainer

    3 days ago

    Hyderabad, Telangana, India Soul AI Full time

    About UsSoul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving...

  • Technical Program Manager

    3 days ago

    Hyderabad, Telangana, India Blue Spire Inc Full time

    About the OpportunityBlue Spire is excited to announce a new opportunity with aleading Banking Clientat their Global Capability Center in Hyderabad. We are hiring a highly capable and detail-orientedTechnical Program Managerto support and drive GenAI-led initiatives across the organization.This position is ideal for professionals experienced in managing...

  • AI Trainer

    3 days ago

    Hyderabad, Telangana, India Soul AI Full time

    About Us:Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving...

  • Senior Manager, Technical Program Management

    2 hours ago

    Hyderabad, Telangana, India The Vanguard Group Full time

    About VanguardFounded in 1975, Vanguard is one of the world's leading investment management companies. The firm offers investments, advice, and retirement services to tens of millions of individual investors around the globe—directly, through workplace plans, and through financial intermediaries.  Vanguard's India OfficeVanguard's office in India is a...