QA/Red Teaming Expert

24 hours ago

Anantapur, India Innodata Inc. Full time

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.


Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert


Key Responsibilities:

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations, and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.


Requirements:

  • Proven experience in AI red teaming, LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering, NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance, content review, or test case development for AI/ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.


Preferred Qualifications:

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.


Kindly Attempt the below assessment to proceed further with your application.


  • https://icap.innodata.com/registerfreelancer?enc=oUTZVsr/Pnz/0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel

  • Sap jva

    4 days ago

    Anantapur, India RED Global Full time

    ***SAP JVA (Joint Venture Accounting) Expert- Contract Opportunity- 100% Remote- 12 months + extension- Full-time- India***Our international IT Consulting client is looking for SAP JVA (Joint Venture Accounting) Expert as below.Job Title: SAP JVA (Joint Venture Accounting) ExpertEngagement: Full timeLocation: 100% RemoteLanguages: English, German (plus)Start...

  • Sr Qa

    2 weeks ago

    Anantapur, Andhra Pradesh, India Vriba Solutions Full time

    Senior Tester JD Vriba is looking for Senior Tester who has real time experience and join its vibrant team and contribute to the company's ongoing exponential growth. Experience: 8-10 years Location: Pune or Remote Key Skills: 8-10 years' experience having Expertise in creating test cases, executing tests, reporting bugs and collaborating with developers...

  • QA Engineer

    2 weeks ago

    Anantapur, Andhra Pradesh, India Avikal Solutions Full time

    QA/ Test EngineerExperience: 5+Location: RemoteSkills: Strong expertise in Google Cloud Platform (GCP), and hands-on data validation skills. The role involves designing and executing test plans, validating large datasets, and ensuring quality across GCP-based solutions.Role Description· Create and maintain test plans, test cases, and reports.· Perform...

  • Hindi linguistics expert

    2 weeks ago

    Anantapur, India Innodata Inc. Full time

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By...

  • Senior Penetration Tester

    1 week ago

    Anantapur, India AppSecure Security Full time

    Location: Fully RemoteAbout UsAppsecure is a leading offensive cybersecurity and red-team services company trusted by Fortune 500s, high-growth startups, and global enterprises. Our team consists of top bug bounty hunters, seasoned red teamers, and security researchers who deliver high-impact security testing across web, mobile, API, and cloud...

  • Quality assurance tester

    2 hours ago

    Anantapur, India WebBuddy LLC Full time

    Company Description Web Buddy is a leading web design and development agency known for transforming ideas into digital realities. With a team comprising expert developers, creative designers, and strategic thinkers, we deliver customized web solutions that drive business growth. Our clients span the US, UK, Canada, and Australia, and we continually innovate...

  • Outpatient Coder – Ancillary Coding Specialist

    1 week ago

    Anantapur, India Care365 SOL Private limited Full time

    We’re Hiring: Outpatient Coder – Ancillary Coding Specialist🏢 Company: Care365 SOL INC🌍 Location: Work From Home⏳ Start Date: Immediate Joiners PreferredAre you an expert in outpatient coding with a sharp eye for ancillary services like radiology, lab, and therapy? Care365 SOL INC is looking for skilled coders to join our remote team and help us...

  • Automation engineer

    2 weeks ago

    Anantapur, India Ananda Services Full time

    Job Title: Automation Engineer (No-Code/Low-Code Expert)Location: RemoteType: Full-TimeAbout UsAt The Ladder, we’re on a mission to build scalable systems that help brands grow faster, smarter, and more efficiently. A huge part of that vision relies on automation-first thinking — whether it's in marketing, sales, operations, or internal...

  • Data Modernization Lead– Databricks Expert

    2 days ago

    Anantapur, India Saradysol Tech Ventures Private Limited Full time

    About the job Job description Job Title: Senior Data Modernization Lead– Databricks Expert (Contract)  Location: Remote Experience Level: 15+ Years Role Overview We are looking for an experienced Data Modernization Lead to spearhead our team’s transition to modern data engineering practices . This role will focus on migrating data assets and...

  • Quality Assurance Automation Engineer

    2 weeks ago

    Anantapur, India TestGrid.io Full time

    Job Title: Quality Assurance Automation EngineerLocation: Remote (India)Employment Type: Full-timeJob Description Company Description TestGrid is a leading provider of end-to-end automation cloud and on-premise testing solutions. The company focuses on simplifying the testing process with innovative AI-powered technology to help organizations achieve time...