QA/Red Teaming Expert

1 week ago

bangalore, India Innodata Inc. Full time

Job Description:

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert

Key Responsibilities:

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements:

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI/ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.

Preferred Qualifications:

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.

Background in linguistics, psychology, or computational ethics is a plus.

Kindly Attempt the below assessment to proceed further with your application.

  • Red Teaming

    1 week ago

    bangalore, India TP Full time

    Role - Red Teaming - Gemini Models Skill : Linguist Languages : en-IN, en-US, hi-IN,es-MX, ja-JP, jo-KO Location : Remote Experience in Gemini model response red teaming Strong understanding of large language models (LLMs) and their potential risks Create mindset & able to generate prompts with cultural awareness Excellent analytical and...

  • Security Engineer

    6 days ago

    bangalore, India Crossing Hurdles Full time

    Job Title: AI Red Team EngineerLocation: RemoteDuration: 2 Months ContractRole Overview:As an AI Red Team Engineer, you'll lead offensive security testing of AI agents, including LLMs that can access connectors (e.g., GDrive, Gmail). Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks before adversaries...

  • Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India RED HAT Full time

    About the Job The Red Hat OpenShift Engineering team is looking for a Software Engineer to join us in Bangalore India In this role you will work in an agile team and contribute to the engineering of Red Hat OpenShift Container Platform and its supporting components in the core of Kubernetes As a Software Engineer you will be a key contributor in...

  • Senior Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India RED HAT Full time

    About the job The Red Hat Performance and Scale Engineering team is looking for a Senior Software Engineer to join us in Bangalore India In this role you will work with a diverse team of highly motivated engineers focused on the performance and scale characterization and improvement of current and future Red Hat solutions You ll have the opportunity...

  • Software Quality Engineer

    3 weeks ago

    Bangalore, Karnataka, India RED HAT Full time

    About the job Quality Engineering at Red Hat offers an inclusive and open environment for engineers to collaborate and build technology solutions for product testing and release readiness Red Hat is the place for you to test your quality engineering mindset and nurture your DevOps and Leadership skills The OpenShift Node team is looking for a Quality...

  • Exit QA Expert

    1 week ago

    Bangalore, Velankani Tech Park, India Deutsche Bank Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Exit QA expert - Associate Job Description: Job Title: Exit QA expert - Associate Location: Bangalore, India Role Description The Offboarding QA Analyst focuses on effective Quality Review of Client Offboarding execution processes. The QA Analyst performs QA Review across various elements of the Offboarding lifecycle, ensuring that files which...

  • Senior Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India RED HAT Full time

    About the Job The Red Hat OpenShift Engineering team is looking for a Senior Software Engineer to join us in Bangalore India In this role you will work in an agile team and contribute to the engineering of Red Hat OpenShift Container Platform and its supporting components in the core of Kubernetes As a Software Engineer you will be a key contributor...

  • ▷ Immediate Start: Senior Software Quality Engineer

    3 weeks ago

    Bangalore, Karnataka, India RED HAT Full time

    About the Job The OpenShift engineering team is looking for a Senior Quality Engineer to be hired in Bangalore India In this role you will work on the next evolution of the must-gather diagnostics tool a core utility used to collect cluster logs and support data in OpenShift Container Platform You ll be responsible for all aspects of quality for Red...

  • Senior Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India RED HAT Full time

    About the Job The Data And AI team is a highly focused effort to lead digital-first execution and transformation at Red Hat leveraging data strategically for our customers partners and associates We are looking for a Senior Software Engineer full stack developer with proven frontend and backend experience to join our team in Bengaluru India In this...

  • Senior python support engineer

    4 days ago

    Bangalore, India Red Education Full time

    Job Title: Senior Python Support Engineer Work Location: Bangalore (Whitefield) Minimum experience : 3+ years of strong Python coding experience, System Administrator with strong Windows Server experience Spoken Language: Good Spoken and written English (must) Work Hours: Full-time (rotational shift) Should be flexible to work in multiple shift Work...