Qa/red teaming expert
6 days ago
Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards. Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert Key Responsibilities: Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs). Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes. Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses. Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations. Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence. Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance. Document findings, edge cases, and vulnerability reports with high clarity and structure. Requirements: Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design. Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI. Strong background in Quality Assurance , content review, or test case development for AI/ML systems. Understanding of LLM behaviour's, failure modes, and model evaluation metrics. Excellent critical thinking, pattern recognition, and analytical writing skills. Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines. Preferred Qualifications: Prior work with teams like Open AI, Anthropic, Google Deep Mind, or other LLM safety initiatives. Experience in risk assessment, red team security testing, or AI policy & governance. Background in linguistics, psychology, or computational ethics is a plus. Kindly Attempt the below assessment to proceed further with your application.
-
Qa/red teaming expert
1 week ago
India Innodata Inc. Full timeJob Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
Qa/red teaming expert
3 days ago
India Innodata Inc. Full timeJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
QA/Red Teaming Expert
1 week ago
India Innodata Inc. Full timeJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...
-
QA/Red Teaming Expert
1 week ago
India Innodata Inc. Full timeJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
QA/Red Teaming Expert
7 days ago
India Innodata Inc. Full timeJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and...
-
QA/Red Teaming Expert
2 weeks ago
India Innodata Inc. Full timeJob Description:We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
▷ 15h Left! QA/Red Teaming Expert
1 week ago
India Innodata Inc. Full timeJob Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation, and AI/LLM Quality Assurance. The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality...
-
Knowledge Domain Expert
23 hours ago
Pune, India Red Hat Full timeJob Description About The Job Red Hat is seeking a highly skilled Knowledge Domain Expert (KDE) to lead the development, management, and optimization of knowledge-centric systems and processes within our organization. The KDE will leverage their Consortium for Service Innovation KCSv6 certification expertise and advanced AI skill sets to drive...
-
Generative ai associate- red teaming
2 weeks ago
India Innodata Inc. Full timeApply urgently if you are interested in Work from Office for 1 month (Contractual) in Bengaluru. We need Writers who have background in Generative AI and have experience working on LLM (Large Language Model). If you are interested, kindly complete the LLM Evaluation assessment (link below). LLM Evaluation Assessment Link: LLM Assessment Guidelines: ...
-
Generative AI Associate- Red Teaming
3 weeks ago
India Innodata Inc. Full timeApply urgently if you are interested in Work from Office for 1 month (Contractual) in Bengaluru. We need Writers who have background in Generative AI and have experience working on LLM (Large Language Model). If you are interested, kindly complete the LLM Evaluation assessment (link below). LLM Evaluation Assessment Link: LLM Assessment Guidelines: ...
