GenAI Analyst

3 weeks ago

india, IN iMerit Technology Full time

Job DescriptionJob Role : Multimodal GenAI Evaluation AnalystTarget Language: EnglishCompany: iMeritPosition Type: Remote - Contractual; min. 20 hours per weekPosition Overview:iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases. These evaluations will directly inform the development and fine-tuning of advanced large language models (LLMs), vision models (LVMs), and multimodal AI systems.Role Responsibilities:Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.Identify subtle errors, hallucinations, or biases in AI responses.Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.Escalate unclear cases and contribute to refining evaluation guidelines.Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.Skills & Competencies:Strong critical reading, observational, and evaluative skills across different modalities.Ability to articulate nuanced judgments with precision and clarity.Excellent English comprehension (CEFR B2 or above); additional languages a plus.Familiarity with LLMs, generative AI, and multimodal systems.Strong attention to detail and ability to apply guidelines consistently.Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.Comfort with evolving workflows, rapid feedback cycles, and complex quality frameworks.Requirements:Bachelor's degree/ diploma or equivalent educational qualification.1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains.Demonstrated experience working with data annotation tools and software platforms.Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.).Ability to adapt quickly to changing project directions and fast-paced work environments.Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training.Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus.While moderation of high-harm/high-risk material is not part of this role, candidates should be aware that occasional exposure to NSFW or otherwise sensitive content may occur due to imperfections in client-provided datasets. Applicants should indicate that they are comfortable working in environments where such incidental exposure is a possibility.What We Offer:Opportunities to shape the evaluation standards for next-generation multimodal AI systems.Innovative and supportive global working environment.Competitive compensation and flexible remote working arrangements.Continuous learning and growth in applied AI evaluation.Join iMerit to help shape the benchmarks and standards that ensure AI systems are accurate, safe, and culturally aware across text, vision, and multimodal applications. If rigorous analysis and innovation excite you, we encourage you to apply

  • Freelance Delivery Lead

    3 weeks ago

    india, IN Leading MNC Full time

    We are seeking a highly skilled and motivated Delivery Lead || Remote with 8+years of experience. If you're passionate about coding, problem-solving, andinnovation, we'd love to hear from you!About UsCodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and...

  • Veeva Developer

    3 weeks ago

    india, IN RandomTrees Full time

    RandomTrees is a leading Data & AI company offering a diverse range of products and services within the data and AI space. We are seeking a skilled eQMS - Veeva Developer. We support multiple industries, including Pharma, Banking, Semiconductor, Oil & Gas, and more. Additionally, we are actively engaged in research and innovation in Generative AI (GenAI) and...

  • AI Consultant

    4 days ago

    india, IN Aventis Solutions Full time

    Aventis Solutions is igniting the AI revolution: Now, our tech partner is establishing a new AI Innovation Hub in Pune, India, and we are hiring AI Consultants to join this flagship build. This is a rare opportunity for ambitious graduates and early-career professionals to work at the intersection of business and technology, supporting AI and GenAI...

  • Lead Developer

    3 weeks ago

    Bangalore Urban, Karnataka, India, IN WNS-Vuram Full time

    As a Lead Developer, you will spearhead initiatives to optimize and expand our use of theAppian platform across various business functions. This leadership role demands a deepunderstanding of Appian’s platform capabilities, strategic vision, and the ability totranslate complex business requirements into efficient technical solutions. You will lead ateam of...

  • Data Engineer

    3 weeks ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Business Analyst

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra HCLTech Full time

    Role SummaryThe Business Analyst plays a pivotal role within the IFRS CTO organization, driving the development and deployment of GenAI-powered solutions through techno-functional expertise. This role requires a strong analytical mindset, proficiency in financial and market data interpretation, and the ability to translate insights into actionable task....

  • GenAI Analyst

    3 weeks ago

    India iMerit Technology Full time

    Job Description Job Role : Multimodal GenAI Evaluation Analyst Target Language: English Company: iMerit Position Type: Remote - Contractual; min. 20 hours per week Position Overview: iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different...

  • GenAI Analyst

    4 weeks ago

    India iMerit Technology Full time

    Job DescriptionJob Role : Multimodal GenAI Evaluation AnalystTarget Language: EnglishCompany: iMeritPosition Type: Remote - Contractual; min. 20 hours per weekPosition Overview:iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities: text,...

  • ▷ High Salary! GenAI Analyst

    3 weeks ago

    India iMerit Technology Full time

    Job Description Job Role : Multimodal GenAI Evaluation Analyst Target Language: English Company: iMerit Position Type: Remote - Contractual; min. 20 hours per week Position Overview: iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different...

  • GenAI Developer

    2 weeks ago

    Pune, India Barclays Full time

    Job Description Join us as a GenAI Developer at Barclays, where you will be responsible for supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to...

  • Senior Application Engineer, GenAI Development

    3 weeks ago

    Hyderabad, Telangana, India, Telangana Pegasystems Full time

    Meet Our Team:As a member of IT Enterprise Business Systems group, you will be working in one of the most innovative groups that leverages latest features of Pega Infinity platform including GenAI capabilities to develop applications that provide portals and buddies for internal & external facing portals. You will work closely with talented engineers and...

  • GenAI Developer

    3 weeks ago

    Bengaluru, India Infosys Limited Full time

    Job Description Job Description: - GenAI Developer - Experience 7yrs 9yrs - Work Location Bangalore Pune Hyderabad Noida - Notice Period Immediate to 30days Key Responsibilities: - Job Overview - We are seeking a highly skilled and innovative Technology Analyst to join our team as a Gen AI Developer - As a key member of our team you will play a crucial role...

  • Genai analyst

    3 weeks ago

    India IMerit Technology Full time

    Job Description Job Role : Multimodal Gen AI Evaluation Analyst Target Language: English Company: i Merit Position Type: Remote - Contractual; min. 20 hours per week Position Overview: i Merit seeks detail-oriented and analytically minded Multimodal Gen AI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across...

  • Genai analyst

    3 weeks ago

    India IMerit Technology Full time

    Job Description Job Role : Multimodal Gen AI Evaluation Analyst Target Language: English Company: i Merit Position Type: Remote - Contractual; min. 20 hours per week Position Overview: i Merit seeks detail-oriented and analytically minded Multimodal Gen AI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different...

  • AI Analyst

    2 days ago

    India Aventis Solutions Full time

    Aventis Solutions is igniting the AI revolution: Now, our tech partner is establishing a new AI Innovation Hub in Pune, India, and we are hiring AI Business Analysts to play a pivotal role in bridging the gap between business stakeholders and technical AI teams. The roles are central to shaping how AI solutions are scoped, delivered, and adopted across a...