
▷ High Salary GenAI Analyst
3 days ago
Job Description
Job Role : Multimodal GenAI Evaluation Analyst
Target Language: English
Company: iMerit
Position Type: Remote - Contractual; min. 20 hours per week
Position Overview:
iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases. These evaluations will directly inform the development and fine-tuning of advanced large language models (LLMs), vision models (LVMs), and multimodal AI systems.
Role Responsibilities:
- Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).
- Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.
- Identify subtle errors, hallucinations, or biases in AI responses.
- Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.
- Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.
- Escalate unclear cases and contribute to refining evaluation guidelines.
- Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.
Skills & Competencies:
- Strong critical reading, observational, and evaluative skills across different modalities.
- Ability to articulate nuanced judgments with precision and clarity.
- Excellent English comprehension (CEFR B2 or above); additional languages a plus.
- Familiarity with LLMs, generative AI, and multimodal systems.
- Strong attention to detail and ability to apply guidelines consistently.
- Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.
- Comfort with evolving workflows, rapid feedback cycles, and complex quality frameworks.
Requirements:
- Bachelor's degree/ diploma or equivalent educational qualification.
- 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.
- Demonstrated experience working with data annotation tools and software platforms.
- Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.).
- Ability to adapt quickly to changing project directions and fast-paced work environments.
- Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training.
- Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus.
While moderation of high-harm/high-risk material is not part of this role, candidates should be aware that occasional exposure to NSFW or otherwise sensitive content may occur due to imperfections in client-provided datasets. Applicants should indicate that they are comfortable working in environments where such incidental exposure is a possibility.
What We Offer:
- Opportunities to shape the evaluation standards for next-generation multimodal AI systems.
- Innovative and supportive global working environment.
- Competitive compensation and flexible remote working arrangements.
- Continuous learning and growth in applied AI evaluation.
Join iMerit to help shape the benchmarks and standards that ensure AI systems are accurate, safe, and culturally aware across text, vision, and multimodal applications. If rigorous analysis and innovation excite you, we encourage you to apply
-
Business Analyst
1 day ago
Pune, Maharashtra, India, Maharashtra HCLTech Full timeRole SummaryThe Business Analyst plays a pivotal role within the IFRS CTO organization, driving the development and deployment of GenAI-powered solutions through techno-functional expertise. This role requires a strong analytical mindset, proficiency in financial and market data interpretation, and the ability to translate insights into actionable task....
-
GenAI Analyst
1 day ago
india, IN iMerit Technology Full timeJob DescriptionJob Role : Multimodal GenAI Evaluation AnalystTarget Language: EnglishCompany: iMeritPosition Type: Remote - Contractual; min. 20 hours per weekPosition Overview:iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text,...
-
Analyst 1 (High Salary)
1 week ago
Bengaluru, India Scoutit Full timeJob Description Hiring Analyst 1 for supporting Global benefits teams global locations. The position provides support to the firm's GB operations in the execution and delivery of consulting services to the end clients. The individual will primarily be responsible for the coordination and completion of research tasks, data collection, data analysis, and...
-
Analyst [High Salary]
1 week ago
India HCLTech Full timeDesignation ANALYST No of Positions 1 Experience Fresher Skill Primary DWP-USS-SERVICE DESK Qualification BE Btech Beng Hons Posting JD attached 1 To adhere to quality standards voice and accent Tech Monitoring regulatory requirements and company policies 2 To ensure positive customer experience and CSAT through First Call...
-
High Salary: GenAI App Developer
2 weeks ago
Chennai, India HCLTech Full timeJob Description Job Title: GenAI App Developer / Full Stack Developer / Python Backend Developer / API Developer / Prompt Engineer Experience - 6Yrs to 12 Yrs Location - Chennai We are seeking a skilled GenAI App Developer (or Full Stack Developer, Python Backend Developer, API Developer, Prompt Engineer) with expertise in API development, backend...
-
GenAI Analyst
4 days ago
India iMerit Technology Full timeJob Description Job Role : Multimodal GenAI Evaluation Analyst Target Language: English Company: iMerit Position Type: Remote - Contractual; min. 20 hours per week Position Overview: iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs...
-
GenAI Analyst
4 days ago
India iMerit Technology Full timeJob DescriptionJob Role : Multimodal GenAI Evaluation AnalystTarget Language: EnglishCompany: iMeritPosition Type: Remote - Contractual; min. 20 hours per weekPosition Overview:iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text,...
-
GenAI Analyst
3 days ago
India iMerit Technology Full timeJob Description Job Role : Multimodal GenAI Evaluation Analyst Target Language: English Company: iMerit Position Type: Remote - Contractual; min. 20 hours per week Position Overview: iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different...
-
▷ High Salary! Business Analyst
2 weeks ago
Bengaluru, India Infosys Limited Full timeJob Description Key Responsibilities: - A day in the life of an Infoscion - As part of the Infosys consulting team your primary role would be to get to the heart of customer issues diagnose problem areas design innovative solutions and facilitate deployment resulting in client delight - You will develop a proposal by owning parts of the proposal document...
-
GenAI Creator
2 weeks ago
India OLIVER+ Full timeJob Description Brandtech+ is a global team of creative thinkers, tech-savvy trendsetters, and production pros specialising in film, CGI, automation, AI, motion design, and digital/print content. We partner with over 300 clients in 40+ countries and counting. Our focus is to connect clients with high-quality solutions, talent and ambitious opportunities...