Principal Test Automation Engineer

3 days ago


kanpur, India beBeeAutomatedTesting Full time

Lead QA - Automated TestingWe are seeking a Lead Quality Assurance Specialist with strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring. This role will lead quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.Key Responsibilities:Develop and scale test automation initiatives with a focus on GenAI and AI systemsDesign and execute LLM evaluation frameworks using: LLM-as-a-Judge (G-Eval, custom evaluators)Implement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsDesign and validate multi-agent evaluation pipelines (tool usage, collaboration, reasoning chains)Perform adversarial and red-team testing: Prompt injection Jailbreak attacks Bias and toxicity detectionConduct API testing for microservices (REST, async workflows)Monitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputsManage synthetic datasets and golden datasets for AI validationImplement observability and trace monitoring using LangFuse, LangSmith, or similar tools



  • kanpur, India beBeeSoftware Full time

    Test Automation Engineer PositionWe are seeking a skilled test automation engineer to join our remote contract team. This is a six-month initial role with the possibility of extension based on performance and project needs.Key Responsibilities:Design, Develop, and Maintain Test Automation Frameworks: Create scalable and reusable frameworks for web, mobile,...


  • Kanpur, India Whatjobs IN C2 Full time

    Job Title: Sr. Automation Test Engineer Mode of Work: US Shift – Night Shift - WFH Job Roles and Responsibilities Design, build, and maintain scalable and reusable test automation frameworks for UI, API, performance, and integration testing. - Understanding the functional requirements from business - Thorough understanding of business, the infrastructure,...


  • kanpur, India beBeeSoftware Full time

    Job Title: Senior Software Development Engineer TestAbout the RoleThe role involves creating and maintaining automated test cases, executing test suites, reviewing and diagnosing reported bugs, and ensuring overall system quality.Create and maintain automated test cases to ensure thorough testing of software systemsDesign, develop, maintain, and troubleshoot...

  • Automation Test Lead

    24 hours ago


    kanpur, India beBeeTest Full time

    Automation Test Engineer - ManualWe are seeking an experienced Automation Test Professional to lead the design and execution of manual test cases, automate testing processes using Selenium (Java), maintain automation suites with TestNG / JUnit, perform functional, regression, and smoke testing, execute API testing using Rest Assured / Postman, log and track...

  • Test Engineer

    7 days ago


    kanpur, India beBeeSoftware Full time

    Fintech Unicorn seeking Senior SDET Engineers who love ensuring that systems millions trust with their money actually work flawlessly.Your testing strategies directly protect millions of users' financial lives - from bulletproof payment flows to reliable banking features that never break.Are you an automation expert or a testing strategist?We're seeking...


  • kanpur, India beBeeSelenium Full time

    Job Title:Selenium Automation Testing with JavaJob Description:We are seeking a skilled automation tester to join our team.The ideal candidate will have experience with Selenium and Java, as well as strong analytical and problem-solving skills.Responsibilities will include designing and developing test automation frameworks, creating and executing automated...


  • kanpur, India Hyly Full time

    Company Description Hyly.AI is multifamily's only Intelligence Fabric, weaving Artificial, Business, and Human intelligence into one operating system for growth. The company connects raw data to decisions, decisions to actions, and actions to measurable outcomes, turning complexity into clarity. Founded in 2010, Hyly.AI has been helping multifamily leaders...


  • kanpur, India beBeeAutomation Full time

    Test Automation ArchitectWe are seeking an experienced professional with expertise in test automation engineering and CI/CD pipeline design.Prior experience with JavaScript, TypeScript, Java, or Python for automation development is preferred.Hands-on experience with Docker and containerization technologies would be beneficial.Expertise in designing and...

  • Automation Engineer

    11 hours ago


    kanpur, India beBeeAutomation Full time

    Job OpportunityWe are looking for a skilled professional to join our team as an Associate Automation Engineer. As a key member of our team, you will have the opportunity to develop your skills in building and maintaining automation test frameworks.The ideal candidate will possess strong knowledge of at least one programming language, preferably Python or...


  • kanpur, India beBeeAutomation Full time

    Job Title: Automation EngineerWe are looking for skilled professionals to join our team as Automation Engineers with expertise in NodeJS, WebdriverIO, Mocha, and Chai. The ideal candidates will be responsible for designing, developing, and maintaining robust automation test frameworks, ensuring high-quality delivery of software releases.Key...