Lead QA – Automated Testing

2 weeks ago

India RapidBrains Full time

Lead QA – Automated Testing & AI Validation Experience: 6+ Years Employment Type: Contract Notice Period: Immediate Role Overview We are seeking a Lead QA – Automated Testing & AI Validation with strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring. This role will lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. Key Responsibilities Lead and scale test automation initiatives with a focus on GenAI and AI systems Design and execute LLM evaluation frameworks using: LLM-as-a-Judge (G-Eval, custom evaluators) Hallucination detection, faithfulness, relevance, precision/recall Implement RAG evaluation frameworks (RAGAS or similar) Build Python-based automation frameworks using PyTest & DeepEval Integrate automation into CI/CD pipelines using GitHub Actions Design and validate multi-agent evaluation pipelines (tool usage, collaboration, reasoning chains) Perform adversarial and red-team testing: Prompt injection Jailbreak attacks Bias and toxicity detection Conduct API testing for microservices (REST, async workflows) Monitor applications using Azure Application Insights & Log Analytics Define automated scoring systems for GenAI outputs Manage synthetic datasets and golden datasets for AI validation Implement observability and trace monitoring using LangFuse, LangSmith, or similar tools Mandatory Skills Test Automation – Python, PyTest, DeepEval LLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-Judge RAG Evaluation – RAGAS, Retrieval Metrics Evaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/Recall Observability & Monitoring – LangFuse, LangSmith CI/CD – GitHub Actions Multi-Agent Testing – Reasoning & Tool Validation Adversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/Toxicity API Testing – REST & Async Workflows Azure Monitoring – App Insights, Log Analytics Synthetic & Golden Dataset Management Automated Scoring System Design for GenAI Outputs

  • Automation Testing

    1 week ago

    India QA InfoTech Full time

    Description Extensive experience in test Automation Experience on Java programming and Python Scripting Experience in Mobile Application Automation **Benefits**: Why QualiTest? Have continuous access to and work with Senior Testing Specialists and Practice Experts Be a part of a leading testing company, globally recognized as a Visionary by Gartner...

  • Lead QA Test Automation Engineer SDET

    2 weeks ago

    India OmniReach Full time

    Role DescriptionWe are looking for 8+ years experience Lead QA Automation Engineers (Engineering background mandatory, Excellent communication, Ability to interact with Customer. Devops automation mindset).This is a full-time remote role for a Lead QA Test Automation Engineer SDET. The individual will be responsible for developing and executing automated...

  • Lead QA Test Automation Engineer SDET

    2 weeks ago

    india, IN OmniReach Full time

    Role DescriptionWe are looking for 8+ years experience Lead QA Automation Engineers (Engineering background mandatory, Excellent communication, Ability to interact with Customer. Devops automation mindset).This is a full-time remote role for a Lead QA Test Automation Engineer SDET. The individual will be responsible for developing and executing automated...

  • Lead QA Test Automation Engineer SDET

    3 weeks ago

    India OmniReach Full time

    Role Description We are looking for 8+ years experience Lead QA Automation Engineers (Engineering background mandatory , Excellent communication, Ability to interact with Customer . Devops automation mindset ). This is a full-time remote role for a Lead QA Test Automation Engineer SDET. The individual will be responsible for developing and executing...

  • QA Automation Testing

    6 days ago

    India Oracle Full time

    **Your Responsibilities** As an integral part of the development/QA team you will be responsible for the following - Work independently with self-drive and minimum monitoring - Understand system specifications - Provide estimates on Test resources and effort to support prioritization and planning - Collaborate with QA Engineers to develop effective...

  • QA Automation Testing

    6 days ago

    India Ushankk Full time

    **QA Automation Testing** *** **Location**: Anywhere in India **Industry**: IT **Skill**: Java **Experience**: 4 - 8 years Hiring for QA Automation Testing _Skillset : Java, Selenium, API testing_ - Exp : 4-8 Years_ - Max Offered : 15 LPA_ - Location : Any_

  • QA Automation Lead

    2 weeks ago

    Bengaluru, India Xoxoday Full time

    Job Description Job Overview We are seeking an experienced QA Automation Lead with 510 years of experience in automation testing, manual testing, test planning, and quality engineering. The ideal candidate will be hands-on with automation tools, possess strong programming skills, and be capable of guiding the QA team in best practices while ensuring the...

  • Functional Testing

    1 week ago

    India QA InfoTech Full time

    Description **Mandatory Skills**: - Knowledge on Netsuite - Minimum 3 years - Knowledge on Salesforce - 3+ years - Excellent communication skills **Requirement**: - 4-7 years of exp in - Functional Testing - knowledge in NetSuite - Sales Order, Suite billing, Invoice, AP and GL) - knowledge in Salesforce - Accounts, Opportunities, Quotes. - Basic...

  • Automation Testing, Java, Selenium

    1 week ago

    India QA InfoTech Full time

    Description 3 years - 7 years of relevant experience in Automation Testing Java/J2EE, Selenium, API Testing. Progressive experience, predominantly in test automation using open source technology stack. Understanding of Test Automation Frameworks. Automation exposure to CRM’s like salesforce/workday/Oracle Domain will be huge...

  • Test Lead/ QA Lead

    4 weeks ago

    Hyderabad, India Divami Full time

    Job Description Job Title: Test Lead / QA Lead Experience: 6-10 Years Location: Hyderabad (On-site / Hybrid) Employment Type: Full-time About Divami Design Labs At Divami, we bring together design, technology, and empathy to craft digital experiences that delight users and drive business results. Our work spans enterprise applications, SaaS platforms,...