AI Evaluation Analyst

4 days ago

Bengaluru, Karnataka, India Ema Full time

About Ema: Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.

Responsibilities:

  1. Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for various enterprise use cases.

  2. Evaluate AI Models: Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.

  3. Generate AI Evaluation Reports: Compile detailed evaluation reports that provide insights for improving persona setups and Ema's AI models.

  4. Test UX Flows: Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema's users.

  5. Automate Testing Flows: Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.

Requirements:

  1. Educational Background: Bachelor's degree in Engineering. Bachelor's degree in Computer Science, Data Science, or a related field is preferred.

  2. Analytical Skills: Exceptional attention to detail with the ability to identify rare and complex edge cases.

  3. Communication Skills: Strong verbal and written English communication abilities..

  4. Professional Experience: 1-3 years of prior professional experience. Background in analytics, prompt engineering, or QA testing is a plus.

Benefits:

  • Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.

  • Learn best practices for solving user problems with GenAI products.

  • Collaborate across cross-functional teams to effectively achieve customer impact.

Ema Unlimited is an equal opportunity employer and is committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity, or genetics.

  • Sales Analyst

    1 week ago

    Bengaluru, Karnataka, India PriceEasy AI Full time

    About PriceEasyPriceEasy is a fast-growing SaaS company transforming how fuel and convenience retailers manage pricing, location intelligence, and in-store profitability. Our AI-powered platform equips retailers with real-time insights to improve decision-making, boost margins, and optimize operations across the board.Position OverviewWe are seeking a Sales...

  • Staff AI engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 14,00,000 - ₹ 24,00,000 per year

    This role is for one of the Weekday's clientsAs a Staff AI Engineer, you will be responsible for the design, development, and deployment of cutting-edge AI models with a core focus on GenAI, LLM fine-tuning, and model optimization. You will lead research and experimentation initiatives, evaluate emerging technologies, and collaborate closely with product,...

  • Staff AI engineer

    2 weeks ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    This role is for one of the Weekday's clientsAs a Staff AI Engineer, you will be responsible for the design, development, and deployment of cutting-edge AI models with a core focus on GenAI, LLM fine-tuning, and model optimization. You will lead research and experimentation initiatives, evaluate emerging technologies, and collaborate closely with product,...

  • Healthcare Business Analyst

    1 week ago

    Bengaluru, Karnataka, India Autonomize AI Full time

    Autonomize AI is at the forefront of transforming healthcare with AI-powered solutions that empower healthcare knowledge workers to make data-driven decisions, improve patient outcomes, and reduce administrative burdens. Our mission is to deliver world-class healthcare outcomes through cutting-edge technology and deep industry expertise.We are growing fast...

  • AI Engineer

    2 days ago

    Bengaluru, Karnataka, India Amogha AI Full time

    About Amogha AIAt Amogha AI, we are building India's first voice-led conversational AI app specifically for mental health, therapy, and emotional well-being. Our mission is to provide a supportive, empathetic listener in your pocket, 24/7. We are creating a next-generation product that understands user context, provides therapy-grade support, and guarantees...

  • Ai developer

    2 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 10,00,000 - ₹ 15,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 10-15 LPA)Min Experience: 3 yearsLocation: BangaloreJobType: full-timeIn this role, you will design, develop, and deploy AI-driven applications that integrate seamlessly with backend systems. You will work closely with cross-functional teams including product, engineering, and data...

  • Ai developer

    2 days ago

    Bengaluru, Karnataka, India Weekday AI Full time

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 10-15 LPA)Min Experience: 3 yearsLocation: BangaloreJobType: full-timeIn this role, you will design, develop, and deploy AI-driven applications that integrate seamlessly with backend systems. You will work closely with cross-functional teams including product, engineering, and data...

  • AI Outcomes Manager

    2 weeks ago

    Bengaluru, Karnataka, India Adopt AI Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Company DescriptionAdopt AI powers modern applications with innovative AI solutions, enabling users to perform complex actions and automate workflows through natural language commands. By facilitating dynamic planning and execution, Adopt AI allows individuals to interact with applications effortlessly, simplifying tasks and unlocking new opportunities for...

  • Quantative Analyst

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka QuantumStreet AI Full time

    Company DescriptionQuantumStreet AI, backed by IBM, is a global leader in AI-driven investment strategies and manages over $7 billion in client assets. Serving prominent banks, asset and wealth managers, and pension funds, QuantumStreet AI specializes in building and deploying AI models for institutional portfolios since 2016. The company provides custom...

  • AI Researcher

    4 days ago

    Bengaluru, Karnataka, India Sarvam AI Full time

    AI Researcher / Research Engineer – Autonomous AgentsLocation: Bengaluru, IndiaTeam: AI Research & Product InnovationType: Full-timeAbout is at the forefront of India's AI revolution, dedicated to building transformative technologies that empower users and redefine digital interactions. Our mission is to develop intelligent systems that seamlessly...