AI Evaluation Analyst

4 days ago

Bengaluru, Karnataka, India Ema Full time ₹ 9,00,000 - ₹ 12,00,000 per year

About Ema: Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.

Responsibilities:

  1. Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for various enterprise use cases.

  2. Evaluate AI Models: Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.

  3. Generate AI Evaluation Reports: Compile detailed evaluation reports that provide insights for improving persona setups and Ema's AI models.

  4. Test UX Flows: Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema's users.

  5. Automate Testing Flows: Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.

Requirements:

  1. Educational Background: Bachelor's degree required. Degrees in engineering, linguistics, or psychology preferred.

  2. Communication Skills: Strong verbal and written English communication skills are essential.

  3. Professional Experience: 1-3 years of prior professional experience. Experience in content creation, QA testing, prompt engineering, or editing is preferred.

Benefits:

  • Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.

  • Learn best practices for solving user problems with GenAI products.

  • Collaborate across cross-functional teams to effectively achieve customer impact.

Ema Unlimited is an equal opportunity employer and is committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity, or genetics.

  • Business Analyst

    4 days ago

    Bengaluru, Karnataka, India Skyfall Ai Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Your RoleAs a Business Analyst IT Operations Data, you will play a pivotal role in creating the foundational data layer that powers our AI platform. Youll work closely with IT domain experts, data engineers, and external consultants to define enterprise-grade use cases, map real-world execution plans, and translate business processes into structured data....

  • Applied AI Researcher

    3 days ago

    Bengaluru, Karnataka, India Yupp AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About YuppWe are a well-funded, rapidly growing, early-stage AI startup headquartered in Silicon Valley that is building a two-sided product -- one side meant for global consumers and the other side for AI builders and researchers. We work on the cutting edge of AI across the stack. Check out our product that was launched recently, and how it solves the...

  • Staff+ AI Engineer

    3 days ago

    Bengaluru, Karnataka, India Yupp AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About YuppWe are a well-funded, rapidly growing, early-stage AI startup headquartered in Silicon Valley that is building a two-sided product -- one side meant for global consumers and the other side for AI builders and researchers. We work on the cutting edge of AI across the stack. Check out our product that was launched recently, and how it solves the...

  • AI Engineer

    6 days ago

    Bengaluru, Karnataka, India CodeRound AI Full time ₹ 3,60,000 - ₹ 7,20,000 per year

    What we're buildingCodeRound AI matches top 5% tech talent to fastest growing VC funded AI startups in Silicon Valley and India.Candidates apply once and get UPTO 20 remote as well as onsite interview opportunities IF selectedTop-tier product startups in US, UAE & India have hired top engineers & ML folk using CodeRound What you'll doBuild and scale our AI...

  • AI Lead

    3 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 20,00,000 - ₹ 30,00,000

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-30 LPA)Min Experience: 6 yearsLocation: BengaluruJobType: full-timeWe are seeking an experienced AI Lead to architect, design, and deliver scalable Generative AI (GenAI) solutions that drive enterprise innovation. This role involves leading the development of advanced AI workflows...

  • AI Lead

    3 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-30 LPA)Min Experience: 6 yearsLocation: BengaluruJobType: full-timeWe are seeking an experienced AI Lead to architect, design, and deliver scalable Generative AI (GenAI) solutions that drive enterprise innovation. This role involves leading the development of advanced AI workflows...

  • AI Lead

    2 days ago

    Bengaluru, Karnataka, India Weekday AI Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-30 LPA)Min Experience: 6 yearsLocation: BengaluruJobType: full-time We are seeking an experienced AI Lead to architect, design, and deliver scalable Generative AI (GenAI) solutions that drive enterprise innovation. This role involves leading the development of advanced AI workflows...

  • AI Analyst

    2 weeks ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Gen AI AnalystWorking experience in Agile environment - knowledge on Cloud Infrastructure and data source integrations - Knowledge on relational Databases and Cognos Analytics - Self-motivated, be able to work independently as well as being a team player - Strong client service focus and willingness to respond to queries and provide deliverables within...

  • Business Analyst

    1 week ago

    Bengaluru, Karnataka, India NoBroker Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Description Business AnalystPosition: Business AnalystLocation: On-siteResponsibilitiesWork with the Insight Team to collect, clean, and preprocess large datasets.Support in building, training, and evaluating machine learning and deep learning models.Assist in developing predictive models and AI solutions to solve real business problems.Perform...

  • AI Lead

    3 days ago

    Bengaluru, Karnataka, India Weekday AI (YC W21) Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-30 LPA)Min Experience: 6 yearsLocation: BengaluruJobType: full-timeWe are seeking an experiencedAI Leadto architect, design, and deliver scalableGenerative AI (GenAI)solutions that drive enterprise innovation. This role involves leading the development of advanced AI workflows using...