Lead QA – Automated Testing

1 day ago

guntur, India RapidBrains Full time

Lead QA – Automated Testing & AI ValidationExperience: 6+ YearsEmployment Type: ContractNotice Period: Immediate Role OverviewWe are seeking a Lead QA – Automated Testing & AI Validation with strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring. This role will lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.Key ResponsibilitiesLead and scale test automation initiatives with a focus on GenAI and AI systemsDesign and execute LLM evaluation frameworks using:LLM-as-a-Judge (G-Eval, custom evaluators)Hallucination detection, faithfulness, relevance, precision/recallImplement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsDesign and validate multi-agent evaluation pipelines (tool usage, collaboration, reasoning chains)Perform adversarial and red-team testing:Prompt injectionJailbreak attacksBias and toxicity detectionConduct API testing for microservices (REST, async workflows)Monitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputsManage synthetic datasets and golden datasets for AI validationImplement observability and trace monitoring using LangFuse, LangSmith, or similar toolsMandatory SkillsTest Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async WorkflowsAzure Monitoring – App Insights, Log AnalyticsSynthetic & Golden Dataset ManagementAutomated Scoring System Design for GenAI Outputs

  • Lead Automated Testing Specialist

    3 days ago

    guntur, India beBeeAutomation Full time

    Automated Test Engineering is a vital function in the development lifecycle, ensuring software products meet the highest quality standards. As a QA Automation Engineer, you will play a crucial role in developing and maintaining automated test scripts using Cypress and JavaScript.Key Responsibilities:Design, develop, and maintain automated test scripts to...

  • Automation QA Engineer

    3 weeks ago

    Guntur, India Webknot Technologies Full time

    Job Title: QA Automation EngineerLocation: BangaloreExperience: 1–3 YearsEmployment Type: Full-TimeRole OverviewWe are looking for a skilled QA Automation Engineer with 1–3 years of experience to design, develop, and execute automated test scripts. The ideal candidate will ensure the quality, performance, and reliability of applications by working...

  • Automated Testing Specialist

    3 days ago

    guntur, India beBeeSenior Full time

    Overview:We are seeking a Senior QA Engineer to lead the migration of a legacy system from the mainframe to a cloud-based Java environment.The ideal candidate will possess advanced proficiency in Java, strong understanding of test approaches and methodologies, and hands-on experience with SOAP/REST API testing.This is an excellent opportunity for a motivated...

  • Senior Automation Test Strategist

    16 hours ago

    guntur, India beBeeAutomation Full time

    Job Title: Automation Test LeadWe are looking for an experienced Automation QA Test Lead to lead our testing efforts in automation.The ideal candidate will have hands-on experience in designing and implementing automated tests for web and mobile applications using Selenium and BDD frameworks. The successful candidate will be responsible for creating and...

  • Advanced Test Automation Professional

    3 days ago

    guntur, India beBeeAutomation Full time

    Job DescriptionWe are seeking a highly skilled Automation QA Engineer to join our team. As a key member of our quality assurance team, you will be responsible for designing, developing and enhancing automation frameworks using TestComplete (Web, Desktop, and Mobile).You will work closely with development teams to understand application logic and ensure...

  • Senior Software Development Engineer

    3 days ago

    guntur, India beBeeAutomation Full time

    Advanced Test Automation EngineerWe are seeking a highly skilled Senior Software Development Engineer in Test to lead our automation efforts.Developing and maintaining efficient test frameworks that cater to diverse testing types, including UI, API, performance, and security.Pioneering an AI-driven testing strategy by integrating cutting-edge AI solutions...

  • Test Automation Engineer

    1 day ago

    guntur, India beBeeSoftwareQuality Full time

    Job DescriptionWe are seeking a detail-oriented Quality Assurance Professional to join our team. This role involves ensuring the delivery of high-quality software solutions by designing and executing effective test strategies.The ideal candidate has hands-on experience in Java, Cypress, and API testing and is passionate about building defect-free software...

  • QA Automation Specialist

    3 days ago

    guntur, India beBeeAutomation Full time

    We are seeking a skilled QA Automation Specialist to lead our test automation efforts.About the RoleThe ideal candidate will have strong expertise in Katalon Studio and proficiency in designing, building, and maintaining automated test frameworks.Design and develop automated test strategies covering unit, integration, system, regression, performance, and...

  • Senior Automated Testing Engineer

    3 days ago

    guntur, India beBeeAutomation Full time

    Automated Test Framework Specialist Job DescriptionAbout the RoleWe are seeking an experienced Automated Test Framework Specialist to join our team. The ideal candidate will have a strong background in software testing and experience with automated test frameworks.Job SummaryThe successful candidate will design, develop, and maintain automated test...

  • Senior Automation Developer

    17 hours ago

    guntur, India beBeeSoftware Full time

    Automation Lead EngineerThis role is focused on developing and implementing high-quality automation frameworks for web and API systems.The ideal candidate will have 4+ years of experience in automation testing with a strong engineering mindset.They should be proficient in building reusable, scalable test frameworks instead of writing isolated scripts.The...