QA/Red Teaming Expert

3 weeks ago

Anantapur, India Innodata Inc. Full time

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.


Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert


Key Responsibilities:

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.


Requirements:

  • Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.


Preferred Qualifications:

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.


Kindly Attempt the below assessment to proceed further with your application.


  • https://icap.innodata.com/registerfreelancer?enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Sap jva

    4 weeks ago

    Anantapur, India RED Global Full time

    ***SAP JVA (Joint Venture Accounting) Expert- Contract Opportunity- 100% Remote- 12 months + extension- Full-time- India***Our international IT Consulting client is looking for SAP JVA (Joint Venture Accounting) Expert as below.Job Title: SAP JVA (Joint Venture Accounting) ExpertEngagement: Full timeLocation: 100% RemoteLanguages: English, German (plus)Start...

  • Qa manual tester

    3 days ago

    Anantapur, India Webmap Network Full time

    Company DescriptionWebmap is the no-code way to supercharge your website with AI, boosting engagement and revenue without complexity. Our platform enables businesses to easily integrate AI tools to optimize user experiences, drive engagement, and increase conversions. By eliminating technical barriers, Webmap allows anyone to enhance their digital presence...

  • Quality assurance tester

    3 weeks ago

    Anantapur, India WebBuddy LLC Full time

    Company Description Web Buddy is a leading web design and development agency known for transforming ideas into digital realities. With a team comprising expert developers, creative designers, and strategic thinkers, we deliver customized web solutions that drive business growth. Our clients span the US, UK, Canada, and Australia, and we continually innovate...

  • Data Modernization Lead– Databricks Expert

    3 weeks ago

    Anantapur, India Saradysol Tech Ventures Private Limited Full time

    About the job Job description Job Title: Senior Data Modernization Lead– Databricks Expert (Contract)  Location: Remote Experience Level: 15+ Years Role Overview We are looking for an experienced Data Modernization Lead to spearhead our team’s transition to modern data engineering practices . This role will focus on migrating data assets and...

  • Designer and AI code expert Lovable, base 44

    2 days ago

    Anantapur, India Learn with Leaders Full time

    Company DescriptionLearn with Leaders (LWL) connects middle and high school students with world-class faculty, thought leaders, and college students globally. LWL empowers young learners to explore new interests, develop global networks, and nurture their creativity through a variety of year-round events and programs — from short-term workshops to mid-term...

  • Technical Lead

    1 week ago

    Anantapur, India Rainier Softech Solutions Pvt Ltd Full time

    - Strong hands-on proficiency in Java (Spring Boot, Spring MVC, Spring JPA, Hibernate). - Working knowledge and implementation experience in Python-based applications. - Proficiency with microservices architecture and RESTful API design. - Strong understanding of NoSQL databases (MongoDB preferred) and SQL-based systems (Oracle PL/SQL). - Solid grasp of...

  • Group Manager

    3 weeks ago

    Anantapur, India Pfizer Full time

    Use Your Power for Purpose Whether you are involved in the design and development of manufacturing processes for products or supporting maintenance and reliability engineering is crucial to ensuring customers and patients receive the medicines they need precisely when they need them By collaborating with our forward-thinking engineering team you will...

  • Spanish Language Speaking Telecaller Female

    7 days ago

    Anantapur, India GML Soft Labs Full time

    Are you a skilled Spanish speaker with a strong background in Sales & customer support? We are currently seeking a talented and detail-oriented individual to join our sales team that requires excellent Spanish language skills. Position**:Spanish Language Expert** **Location: Anantapur** Type: Full-time Shift Timing**:6.30 pm to 3.30 am** As a Spanish...

  • Salesforce marketing cloud qa tester

    4 weeks ago

    Anantapur, India CloudLabs Inc Full time

    About Cloud Labs:Cloud Labs Inc was founded in 2014 with the mission to provide exceptional IT & Business consulting services at a competitive price, to help clients realize the best value from their investments.Within a short span, Cloud Labs evolved from pure-play consulting into a transformative partner for Business Acceleration Advisory, Transformative...

  • Test Automation Engineer-Playwright

    2 weeks ago

    Anantapur, India ImpactQA Full time

    Company Description: -Featured by Everest Group among the top QA companies to watch out for, ImpactQA is a global software testing and quality assurance consulting company that provides services such as Quality Engineering, AI-based Test Automation, Performance Engineering, Security Testing, and a suite of continuous and automated testing services integrated...