Qa/red teaming expert

4 weeks ago

India Innodata Inc. Full time

Job Description: We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI/LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards. Job Title :- Red Teaming, Prompt Evaluation, or AI/LLM Quality Assurance Expert Key Responsibilities: Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs). Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes. Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses. Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations. Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence. Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance. Document findings, edge cases, and vulnerability reports with high clarity and structure. Requirements: Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design. Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI. Strong background in Quality Assurance , content review, or test case development for AI/ML systems. Understanding of LLM behaviour's, failure modes, and model evaluation metrics. Excellent critical thinking, pattern recognition, and analytical writing skills. Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines. Preferred Qualifications: Prior work with teams like Open AI, Anthropic, Google Deep Mind, or other LLM safety initiatives. Experience in risk assessment, red team security testing, or AI policy & governance. Background in linguistics, psychology, or computational ethics is a plus. Kindly Attempt the below assessment to proceed further with your application.

  • Knowledge Domain Expert

    4 weeks ago

    Pune, India Red Hat Full time

    Job Description About The Job Red Hat is seeking a highly skilled Knowledge Domain Expert (KDE) to lead the development, management, and optimization of knowledge-centric systems and processes within our organization. The KDE will leverage their Consortium for Service Innovation KCSv6 certification expertise and advanced AI skill sets to drive...

  • ▷ 15h Left! Project Manager Technical: Customer Service Knowledge Domain Expert

    4 weeks ago

    India RED HAT Full time

    About the job At Red Hat the Global Customer Service team offers an inclusive and collaborative environment where professionals work together to build solutions for data quality governance and knowledge management Red Hat is the place for you to apply your skills in data quality AI and project management while nurturing your leadership capabilities The...

  • Red Teaming Prompt Writer – Cultural Awareness

    4 weeks ago

    Tamil Nadu, India, India Innodata Inc. Full time

    Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By...

  • Security Engineer

    4 weeks ago

    india, IN Crossing Hurdles Full time

    Job Title: AI Red Team EngineerLocation: RemoteDuration: 2 Months ContractRole Overview:As an AI Red Team Engineer, you'll lead offensive security testing of AI agents, including LLMs that can access connectors (e.g., GDrive, Gmail). Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks before adversaries...

  • Security engineer

    4 weeks ago

    India Crossing Hurdles Full time

    Job Title: AI Red Team Engineer Location: Remote Duration: 2 Months Contract Role Overview: As an AI Red Team Engineer , you'll lead offensive security testing of AI agents, including LLMs that can access connectors (e.g., GDrive, Gmail). Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks before adversaries...

  • Security Engineer

    4 weeks ago

    India Crossing Hurdles Full time

    Job Title: AI Red Team Engineer Location: Remote Duration: 2 Months Contract Role Overview: As an AI Red Team Engineer, you'll lead offensive security testing of AI agents, including LLMs that can access connectors (e.g., GDrive, Gmail). Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks before...

  • Security engineer

    4 weeks ago

    India Crossing Hurdles Full time

    Job Title: AI Red Team Engineer Location: Remote Duration: 2 Months Contract Role Overview: As an AI Red Team Engineer , you'll lead offensive security testing of AI agents, including LLMs that can access connectors (e.g., GDrive, Gmail). Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks...

  • Engineering Analyst, Content Adversarial Red Team

    4 weeks ago

    Hyderabad, India Google Full time

    Job Description Minimum qualifications: - Bachelor's degree or equivalent practical experience. - 7 years of experience in data analysis including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data. - 7 years of experience in managing projects and defining project scope, goals, and deliverables....

  • Quality Assurance Tester

    2 weeks ago

    India RED Global Full time

    RED GLOBAL-GENESYS QA/TESTER-INDIA-REMOTE-ASAP-12MONTHS+RED Global, on behalf of a Key Client Partner, is currently searching for a skilled and detail-oriented Genesys QA/Tester to ensure the quality and reliability of our Genesys-based contact center solutions. Please find the details below:Role: Genesys QA/Tester Start: ASAPLocation: Remote – India...

  • Security Engineer

    4 weeks ago

    India Crossing Hurdles Full time

    Job Title: AI Red Team Engineer Location: Remote Duration: 2 Months Contract Role Overview: As an AI Red Team Engineer , you'll lead offensive security testing of AI agents, including LLMs that can access connectors (e.g., GDrive, Gmail). Your focus will be to uncover vulnerabilities, prompt-injection pathways, and data-exfiltration risks before...