Senior Quality Assurance Engineer

1 week ago

india beBeeQuality Full time

Lead AI Quality Assurance ManagerAward-winning Lead AI Quality Assurance Manager sought to spearhead the development of cutting-edge Generative AI and Multi-Agent Systems. As a seasoned expert in AI quality assurance, you will be responsible for leading and scaling test automation initiatives with a focus on GenAI and AI systems.Key Responsibilities:Design and execute Large Language Model (LLM) evaluation frameworks using LLM-as-a-Judge (G-Eval, custom evaluators)Hallucination detection, faithfulness, relevance, precision/recallImplement Retrieval-Augmented Generation (RAG) evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub ActionsConduct API testing for microservices (REST, async workflows)Mandatory Skills:Test Automation – Python, PyTest, DeepEvalLLM Evaluation – G-Eval, Custom Evaluators, LLM-as-a-JudgeRAG Evaluation – RAGAS, Retrieval MetricsEvaluation Metrics – Hallucination, Faithfulness, Relevance, Precision/RecallObservability & Monitoring – LangFuse, LangSmithCI/CD – GitHub ActionsMulti-Agent Testing – Reasoning & Tool ValidationAdversarial/Red Team Testing – Prompt Injection, Jailbreak, Bias/ToxicityAPI Testing – REST & Async Workflows

  • Senior Quality Assurance Engineer

    2 days ago

    Pune, India HeapTrace Technology Full time

    Job Description Description : We are looking for a Quality Assurance Engineer to join our team. As a Quality Assurance Engineer, you will be responsible for creating and implementing strategies for quality coordination, and testing as well as suggesting solutions to identified quality problems. Responsibilities - Review and analyze requirements,...

  • Senior Quality Assurance Engineer

    4 weeks ago

    India Aviso AI Full time

    Job Title: QA Engineer / Senior QA Engineer Location: Remote Employment Type: Full-time Role Type: Senior Individual Contributor (IC) About Aviso AIL: Aviso AI is revolutionizing enterprise sales intelligence with cutting-edge AI solutions for forecasting, deal guidance, and revenue operations. By leveraging machine learning and advanced analytics, we...

  • Senior Quality Assurance Engineer

    4 weeks ago

    India Aviso AI Full time

    Job Title: QA Engineer / Senior QA EngineerLocation: RemoteEmployment Type: Full-timeRole Type: Senior Individual Contributor (IC)About Aviso AIL:Aviso AI is revolutionizing enterprise sales intelligence with cutting-edge AI solutions for forecasting, deal guidance, and revenue operations. By leveraging machine learning and advanced analytics, we empower...

  • Quality Engineer

    4 weeks ago

    Pune, India Quality Precision Industries Full time

    Job Description Company Description Quality Precision Industries, established in 2008 in Pune, is an ISO 9001:2015 certified company renowned for its expertise in forging and precision engineering. Serving industries such as oil and gas, defense, railways, and general engineering, the company specializes in offering end-to-end solutions for forging, heat...

  • Senior Quality Assurance Engineer

    2 weeks ago

    india beBeeQuality Full time

    We are seeking a senior software quality professional to spearhead our QA team and drive the development of high-quality software solutions.Key ResponsibilitiesLeverage expertise in quality assurance to define and implement robust testing strategies that meet business objectives.Develop and mentor junior QA engineers, ensuring they have the skills and...

  • Senior Quality Assurance Engineer

    4 weeks ago

    India MTechZilla Full time

    We are looking for a dedicated Senior QA Engineer who will be responsible for the quality assurance of our software products from concept through deployment. You will be a key member of our product development team, working closely with product owners, developers and other stakeholders to ensure that our solutions meet the highest standards of performance,...

  • Senior Quality Assurance Engineer

    3 weeks ago

    India MTechZilla Full time

    Job Description We are looking for a dedicated Senior QA Engineer who will be responsible for the quality assurance of our software products from concept through deployment. You will be a key member of our product development team, working closely with product owners, developers and other stakeholders to ensure that our solutions meet the highest standards...

  • Senior Quality Assurance Engineer

    4 weeks ago

    India MTechZilla Full time

    We are looking for a dedicated Senior QA Engineer who will be responsible for the quality assurance of our software products from concept through deployment. You will be a key member of our product development team, working closely with product owners, developers and other stakeholders to ensure that our solutions meet the highest standards of performance,...

  • Senior Quality Assurance Engineer Manager

    2 weeks ago

    india beBeeQuality Full time

    Job Title: Senior QA Engineer ManagerThe job entails leading and mentoring the QA team to define quality standards, implementing test automation strategies, establishing and maintaining QA processes across multiple platforms, collaborating with product and development teams to integrate quality into every stage of development.Main Responsibilities:Lead and...

  • Senior Quality Assurance Specialist

    2 weeks ago

    india beBeeSoftware Full time

    Senior Quality Assurance SpecialistWe are seeking a skilled Senior Quality Assurance Specialist to assume a pivotal role in our team.The ideal candidate will have extensive software testing experience, proficiency in manual testing techniques, and an in-depth understanding of API frameworks and best practices.Create and maintain comprehensive test plans,...