Advanced Test Automation Specialist

1 week ago

shimoga, India beBeeAutomation Full time

Lead QA – Automated TestingWe are seeking a highly skilled Lead QA – Automated Testing expert to spearhead our quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems.This role will focus on leading and scaling test automation initiatives with a strong emphasis on GenAI and AI systems, as well as designing and executing LLM evaluation frameworks using LLM-as-a-Judge (G-Eval, custom evaluators).Key Responsibilities:Design and implement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsConduct API testing for microservices (REST, async workflows)Monitor applications using Azure Application Insights & Log AnalyticsDefine automated scoring systems for GenAI outputsManage synthetic datasets and golden datasets for AI validationImplement observability and trace monitoring using LangFuse, LangSmith, or similar toolsRequired Skills and Qualifications:Strong expertise in Python automationLLM evaluation experienceFamiliarity with RAG pipelinesAzure monitoring skillsExperience with adversarial testingKnowledge of multi-agent systemsBenefits:This role offers a unique opportunity to work on cutting-edge technologies and contribute to the development of innovative AI solutions. As a key member of our team, you will have access to ongoing training and professional development opportunities, enabling you to stay up-to-date with the latest industry trends and best practices.Others:Please note that this is a challenging and rewarding role that requires a high level of expertise and dedication. If you are passionate about AI and automation, and possess the necessary skills and qualifications, we encourage you to apply.

  • Automation Testing Specialist

    5 hours ago

    shimoga, India beBeeAutomation Full time

    Automation Testing Specialist Job SummaryWe are seeking an experienced Automation Testing Specialist to join our team. Key responsibilities include:The ideal candidate will have extensive experience in types of testing – Static, System, Functional, Regression, Smoke, Integration and Load testing through SDLC.Ongoing collaboration with developers to clarify...

  • Automation Testing Specialist

    2 weeks ago

    shimoga, India beBeeAutomation Full time

    Job Title: Automation Testing SpecialistWe are seeking a skilled Automation Testing Specialist to join our team. In this role, you will develop and maintain automated test scripts using Cypress and JavaScript.You will work closely with developers, product managers, and other QA engineers to ensure our software products meet quality standards.Your...

  • Automated Testing Specialist

    2 weeks ago

    shimoga, India beBeeAutomation Full time

    Senior Test Automation Engineer (Remote)We are seeking a skilled Test Automation Engineer to join our team and contribute to the development of high-quality software products.Key ResponsibilitiesDesign, plan, and execute test scenarios, test cases, and test plans using automation frameworks such as Selenium, Cypress, or Playwright.Develop and maintain...

  • Test Automation Specialist

    2 days ago

    shimoga, India beBeeAutomation Full time

    Job OverviewWe specialize in innovative quality management systems tailored for the life sciences sector.Our ideal candidate will own the creation and maintenance of our automated E2E test suite, collaborating with testers and engineers to achieve this goal.Create, expand, and maintain automated E2E and API test suites for different projects.Support manual...

  • Automation Specialist

    1 week ago

    shimoga, India beBeeAutomation Full time

    Job DescriptionWe are seeking skilled Automation Specialists to join our team, focusing on designing and maintaining robust automation test frameworks for high-quality software releases.Key Responsibilities:Develop automated test scripts using NodeJS + WebdriverIO + Mocha + Chai technologiesExecute comprehensive test suites for regression, functional, and...

  • Senior Test Automation Engineer

    2 weeks ago

    shimoga, India beBeeTestAutomation Full time

    Role Summary:As a Test Automation Specialist, you will be responsible for designing and implementing automated testing solutions using Playwright for frontend applications.Key Responsibilities include:Developing and maintaining automated test frameworks to ensure efficient and reliable testing.Collaborating with cross-functional teams to identify...

  • Test Automation Specialist

    2 weeks ago

    shimoga, India beBeeLeadership Full time

    Quality Assurance LeaderYou'll spearhead automation, performance, and data integrity initiatives — ensuring our product can handle thousands of customers, hundreds of thousands of users, and enterprise-grade expectations without breaking.Key Outcomes:Establish a scalable automation framework that's resilient to UI changes and supports continuous...

  • Senior Test Automation Specialist

    1 week ago

    shimoga, India beBeeAutomation Full time

    Job Opportunity:We are seeking a skilled Automation Engineer to join our team.About the Role:Design, develop, and maintain automation frameworks using Cypress and Playwright for web-based applications.Perform end-to-end manual and automation testing to ensure high-quality software releases.Analyze functional & non-functional requirements and identify scope...

  • Unlock the Power of Advanced Search

    2 days ago

    shimoga, India beBeeSearch Full time

    Job Title: Advanced Search SpecialistWe're seeking an experienced Advanced Search Specialist to design and implement sophisticated search solutions using OpenSearch/Elasticsearch.Main Responsibilities:Custom Search Development: Design, develop, and deploy custom analysers, tokenisers, and scoring algorithms to enhance search functionality.Index & Template...

  • ERP Testing Specialist

    2 weeks ago

    shimoga, India beBeeerp Full time

    Job Title: ERP Testing SpecialistWe are seeking a highly skilled and experienced ERP testing specialist to join our team. The successful candidate will be responsible for performing functional, integration, regression and end-to-end testing activities on our Enterprise Resource Planning (ERP) system.About the Role:This is an exciting opportunity for a...