QA/Red Teaming Expert

3 weeks ago

Alappuzha, India Innodata Inc. Full time

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.


Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert


Key Responsibilities:

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.


Requirements:

  • Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.


Preferred Qualifications:

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.


Kindly Attempt the below assessment to proceed further with your application.


  • https://icap.innodata.com/registerfreelancer?enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Process Optimisation Analyst

    4 weeks ago

    Alappuzha, India RED Global Full time

    Process Optimisation Analyst - 6 months renewable contract - RemoteProcess Optimisation Analyst focused on transforming business operations through data-driven insights, process reengineering, and intelligent automation. This role will play a key part in identifying inefficiencies, eliminating waste, and maximizing the value of automation and process mining...

  • Performance Marketing Expert

    3 weeks ago

    Alappuzha, India Raven Labs Full time

    Location: Remote (India, Sri Lanka, or Philippines) or Hybrid (Hyderabad Office)Type: Full-timeAbout UsAt Raven Labs, we help organizations become truly AI-ready. From strategy to systems, we build powerful, AI-infused solutions that drive measurable business growth. Now, we’re looking for a Performance Marketing Expert who is both a strategist and...

  • Quality Assurance Tester

    3 weeks ago

    Alappuzha, India WebBuddy LLC Full time

    Company Description WebBuddy is a leading web design and development agency known for transforming ideas into digital realities. With a team comprising expert developers, creative designers, and strategic thinkers, we deliver customized web solutions that drive business growth. Our clients span the US, UK, Canada, and Australia, and we continually innovate...

  • UI/UX Designer

    3 weeks ago

    Alappuzha, India Kasha Full time

    Kasha is a global platform designed to empower small business owners, solopreneurs, and freelancers by providing an all-in-one tool to start, run, and grow their businesses. We address the inefficiencies of fragmented tools and multiple subscriptions by offering a seamless solution that integrates company formation, banking, invoicing, client management,...

  • Principal Quality Assurance Engineer

    2 weeks ago

    Alappuzha, India CES Full time

    About the Role We are looking for a Principal QA Engineer (Cypress) to lead testing strategy, automation, and quality initiatives across our agile development teams. This role is a key part of ensuring our products are reliable, scalable, and deliver great experiences for our users. You'll take ownership of both the hands-on execution and the strategic...

  • Senior Project Manager

    4 weeks ago

    Alappuzha, India NEOGOV Full time

    NGV Software India Private LimitedTechnical Project Manager for AGILE Software Product DevelopmentNEOGOV, an HRIS Product company based in Los Angeles is the market and technology leader in human resources software for the public sector.We are seeking an experienced Senior Project Manager (PMO) from India to lead program and project management across 4–5...

  • Ai team web developer — react

    3 weeks ago

    Alappuzha, India Visual AId Full time

    Company DescriptionVisual AID is a startup pioneering AI-driven cosmetic surgery planning, focusing on developing a bias-free, inclusive Novel Human-Face Medical Model through rigorous research and medical testing. By leveraging cutting-edge AI technology, we aim to revolutionize the cosmetic surgery industry, providing patients with advanced decision...

  • Quality Assurance Engineer

    2 weeks ago

    Alappuzha, India TerraFinn Technologies, Mumbai Full time

    Company Name: TerraFinn TechnologiesWebsite: www.terrafinn.comClient: Fitch Ratings Website: https://www.fitchratings.com/ Salary: 25+ lacs Mode: Full-time, remote Experience: 6+ YearsJoining: Immediate Lead/Senior Quality Assurance About the RoleWe are seeking a highly skilled Automation QA Engineer with expertise in AI-driven testing to join our quality...

  • Manual QA Engineer

    3 weeks ago

    Alappuzha, India CONNECTING 2 WORK Full time

    Job Description RESPONSIBILITIES Create tests to identify software problems Analyze bugs and errors found during tests Document results of tests for the software development team Recommend improvements in software to enhance user experience Motivate the development process for efficiency and performance Works together with the software...

  • Quality assurance engineer

    3 weeks ago

    Alappuzha, India TRDFIN Support Services Pvt Ltd Full time

    We are building a modern, scalable web platform using a headless CMS architecture powered by Drupal (backend) and Next.js (frontend). To ensure the platform’s quality, performance, and reliability, we are looking for an experienced QA Engineer who is passionate about testing, quality assurance, and modern web technologies.This role is a great opportunity...