QA/Red Teaming Expert

2 days ago

Alappuzha, India Innodata Inc. Full time

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.


Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert


Key Responsibilities:

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.


Requirements:

  • Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.


Preferred Qualifications:

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.


Kindly Attempt the below assessment to proceed further with your application.


  • https://icap.innodata.com/registerfreelancer?enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • ▷ [Urgent Search] Salesforce QA (Direct Consultant role for 6 Months)

    1 week ago

    Alappuzha, India Reflections Technologies Full time

    We are 4 to 6 years of experience in QA and minimum 4+ years in Salesforce application. Job Location: Remote Mode: Contract (6 Months duration) Job Description - Experience in QA and Salesforce application. - Agile Development: Experience working in Agile/Scrum teams, sprint planning, and estimation. - Salesforce Platform Knowledge – Understanding of...

  • Process Optimisation Analyst

    1 week ago

    Alappuzha, India RED Global Full time

    Process Optimisation Analyst - 6 months renewable contract - RemoteProcess Optimisation Analyst focused on transforming business operations through data-driven insights, process reengineering, and intelligent automation. This role will play a key part in identifying inefficiencies, eliminating waste, and maximizing the value of automation and process mining...

  • Quality Assurance Tester

    2 days ago

    Alappuzha, India WebBuddy LLC Full time

    Company Description WebBuddy is a leading web design and development agency known for transforming ideas into digital realities. With a team comprising expert developers, creative designers, and strategic thinkers, we deliver customized web solutions that drive business growth. Our clients span the US, UK, Canada, and Australia, and we continually innovate...

  • Quality assurance engineer

    2 weeks ago

    Alappuzha, India Blossom Social Full time

    Job Title: QA EngineerAbout Blossom Social: Blossom Social is building the future of social investing. Our platform empowers retail investors by combining the best of social networks with investing tools—enabling users to connect, learn, and grow their financial confidence together. Join us to discover new investment ideas, manage your stock portfolio,...

  • Quality assurance automation engineer

    2 weeks ago

    Alappuzha, India TestGrid.io Full time

    Job Title: Quality Assurance Automation EngineerLocation: Remote (India)Employment Type: Full-timeJob Description Company Description Test Grid is a leading provider of end-to-end automation cloud and on-premise testing solutions. The company focuses on simplifying the testing process with innovative AI-powered technology to help organizations achieve time...

  • Senior Project Manager

    6 days ago

    Alappuzha, India NEOGOV Full time

    NGV Software India Private LimitedTechnical Project Manager for AGILE Software Product DevelopmentNEOGOV, an HRIS Product company based in Los Angeles is the market and technology leader in human resources software for the public sector.We are seeking an experienced Senior Project Manager (PMO) from India to lead program and project management across 4–5...

  • Manual QA Engineer

    2 weeks ago

    Alappuzha, India CONNECTING 2 WORK Full time

    Job Description RESPONSIBILITIES Create tests to identify software problems Analyze bugs and errors found during tests Document results of tests for the software development team Recommend improvements in software to enhance user experience Motivate the development process for efficiency and performance Works together with the software developer to...

  • Performance Marketing Expert

    17 hours ago

    Alappuzha, India Raven Labs Full time

    Location: Remote (India, Sri Lanka, or Philippines) or Hybrid (Hyderabad Office)Type: Full-timeAbout UsAt Raven Labs, we help organizations become truly AI-ready. From strategy to systems, we build powerful, AI-infused solutions that drive measurable business growth. Now, we’re looking for a Performance Marketing Expert who is both a strategist and...

  • UI/UX Designer

    2 days ago

    Alappuzha, India Kasha Full time

    Kasha is a global platform designed to empower small business owners, solopreneurs, and freelancers by providing an all-in-one tool to start, run, and grow their businesses. We address the inefficiencies of fragmented tools and multiple subscriptions by offering a seamless solution that integrates company formation, banking, invoicing, client management,...

  • Sap tosca automation tester

    2 weeks ago

    Alappuzha, India Aptonet Full time

    ???? We’re Hiring – SAP Tosca Automation Tester???? Offshore | Long-Term Contract (6 Months to Start – Extendable)Join our dynamic QA team to deliver high-quality SAP testing solutions using Tosca automation. This role focuses on SAP MM & Finance modules, ensuring seamless integration and reliable performance across enterprise systems.Role...