Principal Automation Specialist

1 week ago


ajmer, India beBeeQuality Full time

Lead Quality Assurance Engineer – Automated Testing & AI ValidationJob Summary:We are seeking an experienced Lead Quality Assurance Engineer to lead our quality assurance initiatives for cutting-edge Generative AI and Multi-Agent Systems. This role requires a strong background in test automation, LLM evaluation, RAG pipelines, observability, adversarial testing, and Azure monitoring.Responsibilities:Design and execute LLM evaluation frameworks using G-Eval, custom evaluators, and LLM-as-a-JudgeImplement RAG evaluation frameworks (RAGAS or similar)Build Python-based automation frameworks using PyTest & DeepEvalIntegrate automation into CI/CD pipelines using GitHub ActionsConduct API testing for microservices (REST, async workflows)Monitor applications using Azure Application Insights & Log AnalyticsRequirements:6+ years of experience in test automation and quality assuranceStrong expertise in Python, PyTest, and DeepEvalFamiliarity with LLM evaluation, RAG pipelines, and observabilityExperience with Azure monitoring and GitHub ActionsMastery of continuous integration and delivery pipelinesBenefits:This role offers a unique opportunity to work on cutting-edge projects and collaborate with a talented team of engineers. We offer a competitive salary and benefits package, as well as opportunities for professional growth and development.



  • ajmer, India beBeeAutomation Full time

    Job OverviewWe are seeking an experienced specialist to excel in systems design and automation. The ideal candidate will own the configuration, automation, and integration of our Zoho ecosystem, including Zoho CRM, Forms, Flow, and Deluge-based automations.You will work closely with the team to gather requirements, implement solutions quickly, and keep the...


  • ajmer, India beBeeAutomation Full time

    Test Automation ExpertWe are seeking a skilled automation specialist to fill this role.In this position, you will be responsible for creating and implementing behavior-driven development (BDD) test scenarios based on business requirements.You will:Create BDD test scenarios based on business needsAdd an automation layer for the BDD tests that contribute to...


  • ajmer, India beBeeAutomation Full time

    HubCredo is seeking a highly skilled workflow automation specialist to build, optimize and maintain advanced n8n workflows.About the RoleThis role involves architecting scalable workflows, integrating multiple systems using REST APIs, webhooks and OAuth, and developing logic-driven backend processes. The ideal candidate will have hands-on experience with n8n...


  • ajmer, India beBeeAutomation Full time

    Software Quality Assurance SpecialistOur team is seeking a skilled Software Quality Assurance Specialist to ensure the highest quality of our software applications.Key Responsibilities:Develop and execute automated tests using tools like Selenium and Rest Assured.Collaborate with development teams to identify and prioritize testing needs.Analyze and report...


  • ajmer, India beBeeAutomation Full time

    Automation Testing SpecialistWe are seeking a skilled Automation Testing Specialist with strong expertise in Python-based UI, API, and WebSocket automation. As part of our dynamic team, you will collaborate closely with developers, project managers, and QA peers to ensure product quality, performance, and reliability.Key Responsibilities:Craft Test...


  • ajmer, India beBeeAutomation Full time

    Automation Specialist PositionA proficient Automation Specialist is required to lead the implementation of test automation strategy and execution. The ideal candidate will have 6-10 years of experience in automation testing, with a strong focus on API/UI automation using Java and Selenium.The selected individual will be responsible for creating automated...


  • ajmer, India beBeeAutomation Full time

    Automation SpecialistAbout the Role:We are seeking a highly skilled automation specialist to design and build complex workflows, automate multi-step processes, integrate APIs, and develop logic-driven automation systems.This role involves solving complex problems, architecting scalable workflows, guiding team members, and ensuring all systems run...


  • ajmer, India beBeeAutomation Full time

    We are currently seeking a skilled Automation Specialist to join our team. As an experienced Automation Engineer, you will be responsible for designing and developing robust automation test frameworks.Utilize NodeJS, WebdriverIO, Mocha, and Chai to create automated test scripts.Execute comprehensive automated test suites for regression, functional, and...


  • ajmer, India beBeeAutomation Full time

    Senior Automation EngineerWe are seeking an experienced Senior Automation Engineer to develop complex workflows, automate business processes, integrate APIs, and create logic-driven automation systems.Design and implement advanced automation workflows for internal operations, sales, CRM, lead-gen, reporting, and website automations.Integrate multiple systems...


  • ajmer, India beBeeSoftware Full time

    Job OpportunityWe are seeking a skilled test automation professional to design, develop and maintain robust automation frameworks.Develop scalable automation frameworks using Playwright with TypeScript.Automate UI, API, and backend tests with high reliability and performance.The key responsibilities include:Test Automation ExpertiseIntegrate automated test...