AI Evaluation Analyst

3 days ago

Bengaluru, Karnataka, India Ema Full time ₹ 15,00,000 - ₹ 25,00,000 per year

About Ema: Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.

Responsibilities:

  • Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for various enterprise use cases.
  • Evaluate AI Models: Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.
  • Generate AI Evaluation Reports: Compile detailed evaluation reports that provide insights for improving persona setups and Ema's AI models.
  • Test UX Flows: Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema's users.
  • Automate Testing Flows: Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.

Requirements:

  • Educational Background: Bachelor's degree required. Degrees in engineering, linguistics, or psychology preferred.
  • Communication Skills: Strong verbal and written English communication skills are essential.
  • Professional Experience: 1-3 years of prior professional experience. Experience in content creation, QA testing, prompt engineering, or editing is preferred.

Benefits:

  • Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.
  • Learn best practices for solving user problems with GenAI products.
  • Collaborate across cross-functional teams to effectively achieve customer impact.

Ema Unlimited is an equal opportunity employer and is committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity, or genetics.

  • Innovation analyst

    3 weeks ago

    Bengaluru, Karnataka, India Scry AI Full time

    Position: Innovation Analyst (Enterprise AI & Emerging Technologies)Location: India (Remote)Employment Type: Full-TimeSchedule: Monday to Friday, Day ShiftExperience: 2+ Years in Business Analysis, Research, or Technology InnovationCompany DescriptionScry AI is a research-led enterprise AI company that builds intelligent platforms for BFSI, insurance,...

  • Innovation Analyst

    3 weeks ago

    Bengaluru, Karnataka, India Scry AI Full time

    Position: Innovation Analyst (Enterprise AI & Emerging Technologies)Location: India (Remote)Employment Type: Full-TimeSchedule: Monday to Friday, Day ShiftExperience: 2+ Years in Business Analysis, Research, or Technology InnovationCompany DescriptionScry AI is a research-led enterprise AI company that builds intelligent platforms for BFSI, insurance,...

  • Innovation Analyst

    3 weeks ago

    Bengaluru, Karnataka, India Scry AI Full time

    Position: Innovation Analyst (Enterprise AI & Emerging Technologies)Location: India (Remote)Employment Type: Full-TimeSchedule: Monday to Friday, Day ShiftExperience: 2+ Years in Business Analysis, Research, or Technology InnovationCompany DescriptionScry AI is a research-led enterprise AI company that builds intelligent platforms for BFSI, insurance,...

  • Innovation Analyst

    3 weeks ago

    Bengaluru, Karnataka, India Scry AI Full time

    Position: Innovation Analyst (Enterprise AI & Emerging Technologies) Location: India (Remote) Employment Type: Full-Time Schedule: Monday to Friday, Day Shift Experience: 2+ Years in Business Analysis, Research, or Technology Innovation Company Description Scry AI is a research-led enterprise AI company that builds intelligent platforms...

  • Business Analyst

    3 days ago

    Bengaluru, Karnataka, India Skyfall Ai Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Your RoleAs a Business Analyst IT Operations Data, you will play a pivotal role in creating the foundational data layer that powers our AI platform. Youll work closely with IT domain experts, data engineers, and external consultants to define enterprise-grade use cases, map real-world execution plans, and translate business processes into structured data....

  • Applied AI Researcher

    3 days ago

    Bengaluru, Karnataka, India Yupp AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About YuppWe are a well-funded, rapidly growing, early-stage AI startup headquartered in Silicon Valley that is building a two-sided product -- one side meant for global consumers and the other side for AI builders and researchers. We work on the cutting edge of AI across the stack. Check out our product that was launched recently, and how it solves the...

  • Staff+ AI Engineer

    3 days ago

    Bengaluru, Karnataka, India Yupp AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About YuppWe are a well-funded, rapidly growing, early-stage AI startup headquartered in Silicon Valley that is building a two-sided product -- one side meant for global consumers and the other side for AI builders and researchers. We work on the cutting edge of AI across the stack. Check out our product that was launched recently, and how it solves the...

  • Business Analyst

    3 weeks ago

    Bengaluru, Karnataka, India FinTech AI Innovations Full time

    Company DescriptionA fast-paced and lean FinTech SaaS startup focussed on disruptive innovation in Indirect Taxes & Global Trade. We leverage cutting-edge AI patterns and techniques to drive differentiation and value to our corporate customer base. This role offers the opportunity to work with and learn cutting-edge AI techniquesRole DescriptionOFFICE-Based...

  • Business Analyst

    3 weeks ago

    Bengaluru, Karnataka, India FinTech AI Innovations Full time

    Company DescriptionA fast-paced and lean FinTech SaaS startup focussed on disruptive innovation in Indirect Taxes & Global Trade. We leverage cutting-edge AI patterns and techniques to drive differentiation and value to our corporate customer base. This role offers the opportunity to work with and learn cutting-edge AI techniquesRole DescriptionOFFICE-Based...

  • Business Analyst

    3 weeks ago

    Bengaluru, Karnataka, India FinTech AI Innovations Full time

    Company Description A fast-paced and lean FinTech SaaS startup focussed on disruptive innovation in Indirect Taxes & Global Trade. We leverage cutting-edge AI patterns and techniques to drive differentiation and value to our corporate customer base. This role offers the opportunity to work with and learn cutting-edge AI techniques Role Description ...