Automation Test Lead

2 months ago

Bangalore, India Winning Edge Full time

Job Description :


- Design, develop, and maintain automated test frameworks and scripts for applications utilizing LLMs, ensuring comprehensive coverage of all functionalities and user scenarios.

- Understand Retrieval Augmented Generation(RAG) strategy to improve testing for knowledge-intensive tasks by retrieving relevant documents or data that can be used as references or benchmarks for evaluating the LLM's responses

- Exposure to various Gen AI Testing Frameworks like RAGAS, Deepeval, BenchLLM

- Perform thorough regression testing when bugs are resolved and when there are updates to LLMs or application features.

- Collaborate with development teams to understand application features and integration points for Large Language Models, identifying potential areas for automation.

- Execute automated and manual test cases, analyze test results, identify and document defects, and work closely with developers to ensure they are addressed promptly.

- Monitor the performance of LLMs in the chat interface, identifying any issues with latency, accuracy, or relevance of responses.

- Stay up-to-date with the latest developments in AI, machine learning, and chatbot technologies to continually improve testing strategies and tools.

- Collaborate with product managers and UX designers to ensure the chat application meets the highest standards of user satisfaction and engagement.

- Ensure compliance with data privacy and security policies during the testing process, especially when handling sensitive user data.

- Provide detailed reports and documentation on test activities, results, insights, and recommendations for improving the application's quality and performance.

Preferred Qualifications :

- Should be a Passionate tester with development exposure for SDET role.

- Good understanding of automation tools, technology landscape, and OOPS concepts.

- Experience in testing and automation in agile and continuous delivery models

- Experience in Test Driven and Behaviour Driven Automation Framework Development.

- Experience working in regulated environments and with internal systems quality policies and procedures

- Experience in working in Scrum - agile methodologies, coding standards, code reviews, source management, build processes (CI/CD Pipeline).

- Knowledge of the data architectures associated with information integration, data visualization, & data warehousing

- Pharmaceutical or healthcare industry experience

- Defining best practices and developing technical standards, design principals, best practices, and frameworks

- Technical curiosity and desire to innovate

Technical Leadership :

- Partner with and influence vendor resources on testing process, examine the existing testing processes (manual and automation both) and suggest improvements in terms of the adoption of new approaches which can improve quality and shorten test cycles.

- Check the feasibility of requirements whether they could be automated or if there are some cases that must stay as manual.

- Leverage existing frameworks at an enterprise level and build new frameworks by integrating with the existing tools and infrastructure.

- Communicating with internal and external stakeholders regarding testing progress and timelines by providing testing reports and metrics.

- Responsible to communicate across the testing community and development teams; Sharing knowledge via training session.

- Work collaboratively with delivery teams to ensure timely project delivery.

- Responsible for understanding, designing, and writing test scenarios and test cases; updating test cases based on the requirement changes.

- Responsible for bug classification & analysis using defect tracking tools such as JIRA, Bugzilla, Mantis.

- Ability to adapt quickly in a constantly changing environment

(ref:hirist.tech)

  • Test Lead

    4 weeks ago

    Bangalore, India Pro-Test Consulting Pvt Ltd Full time

    Job Description : - 5 to 6 Years of work experience in both manual and automation - Must have 3 years of hand on experience as a test lead. - Provide technical leadership and expertise within the field of Quality Assurance and Testing - Excellent written and verbal communication and presentation skills - Experience working in an Agile Scrum QA environment....

  • Avo Automation | Test Engineer | bangalore

    4 weeks ago

    bangalore, India Avo Automation Full time

    Avo Automation is a SaaS business focused on automation of the software delivery process. Our Platform is recognized as leader by market leading analyst like Gartner and G2. We are a young and fast-moving business that looks for hungry and driven people to join our team. We offer a holistic, enterprise-grade platform that unifies test automation and test...

  • Avo Automation | Test Engineer | bangalore

    1 month ago

    bangalore, India Avo Automation Full time

    Avo Automation is a SaaS business focused on automation of the software delivery process. Our Platform is recognized as leader by market leading analyst like Gartner and G2. We are a young and fast-moving business that looks for hungry and driven people to join our team. We offer a holistic, enterprise-grade platform that unifies test automation and test...

  • Avo Automation | Test Engineer | bangalore

    4 weeks ago

    bangalore, India Avo Automation Full time

    Avo Automation is a SaaS business focused on automation of the software delivery process. Our Platform is recognized as leader by market leading analyst like Gartner and G2. We are a young and fast-moving business that looks for hungry and driven people to join our team. We offer a holistic, enterprise-grade platform that unifies test automation and test...

  • Test Engineer

    4 weeks ago

    Bangalore, India Pro-Test Consulting Pvt Ltd Full time

    Job Description : - Proven 3+ years of hands-on experience in developing and maintaining Test Automation for Web & Mobile Applications - Excellent written and verbal communication and presentation skills - Experience working in an Agile Scrum QA environment. - Experience in API Testing preferably Rest API, Rest Assured (Microservices) with Postman/newman...

  • Test engineer

    2 weeks ago

    Bangalore, India Avo Automation Full time

    Avo Automation is a Saa S business focused on automation of the software delivery process. Our Platform is recognized as leader by market leading analyst like Gartner and G2. We are a young and fast-moving business that looks for hungry and driven people to join our team. We offer a holistic, enterprise-grade platform that unifies test automation and test...

  • Automation Test Lead

    2 months ago

    bangalore, India Birlasoft Full time

    About BirlasoftBirlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • Automation Test Lead

    2 months ago

    bangalore, India Birlasoft Full time

    About BirlasoftBirlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • Automation Test Lead

    2 months ago

    bangalore, India Birlasoft Full time

    About Birlasoft Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • Automation Test Lead

    1 month ago

    Bangalore, India Luxoft Full time

    Project Description: Applications are invited for the position of Lead QA Manual/Automation for Web App with Telecom expertise, working for the one of Luxoft's clients as part of a telecom test solution engineering team. The successful candidate will work as a key member of the telecom test solution Engineering team. We are contributing to a family...

  • Automation Test Lead

    1 month ago

    Bangalore, India Luxoft Full time

    Project Description: Applications are invited for the position of Lead QA Manual/Automation for Web App with Telecom expertise, working for the one of Luxoft's clients as part of a telecom test solution engineering team. The successful candidate will work as a key member of the telecom test solution Engineering team. We are contributing to a family...

  • Api automation test lead

    2 months ago

    Bangalore, India Eximietas Design Full time

    About Eximietas Design Eximietas, a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, VLSI, Embedded Software, and Artificial Intelligence, Eximietas is dedicatedto empowering businesses with...

  • API Automation Test Lead

    2 months ago

    bangalore, India Eximietas Design Full time

    About Eximietas Designa technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, VLSI, Embedded Software, and Artificial Intelligence, Eximietas is dedicatedto empowering businesses with cutting-edge...

  • API Automation Test Lead

    2 months ago

    Bangalore, India Eximietas Design Full time

    About Eximietas Design Eximietas, a technology services and solutions company headquartered in San Jose, CA with a global footprint that extends to Bangalore, Chennai, and Bhubaneswar in India. Specializing in Cloud Computing, Cybersecurity, VLSI, Embedded Software, and Artificial Intelligence, Eximietas is dedicatedto empowering businesses with...

  • Test automation lead

    3 weeks ago

    Bangalore, India Quess Corp Limited Full time

    Role: Test Automation Lead - Playwright Experience: 6+ Years Work Location: Bangalore Notice Period: Immediate Responsibilities: Design, develop, and maintain comprehensive test automation suites using Playwright (Coded UI) Create and execute test cases to validate Microsoft D365 functionality and integration points. Clearly communicating...

  • Automation Test Lead

    2 months ago

    bangalore, India ITC Infotech Full time

    Expertise in designing, developing, maintaining and executing automated test scripts to ensure defect-free desktop applications and JSON and XML web servicesMust have strong experience with the HP UFT automation toolMust have experience with scripting languages such as VBScript , and Test Rail for test lifecycle managementExperience working with the Agile...

  • Automation Test Lead

    2 months ago

    bangalore, India ITC Infotech Full time

    Expertise in designing, developing, maintaining and executing automated test scripts to ensure defect-free desktop applications and JSON and XML web services Must have strong experience with the HP UFT automation tool Must have experience with scripting languages such as VBScript , and Test Rail for test lifecycle management Experience working with the...

  • Automation Test Lead

    2 months ago

    bangalore, India ITC Infotech Full time

    Expertise in designing, developing, maintaining and executing automated test scripts to ensure defect-free desktop applications and JSON and XML web servicesMust have strong experience with the HP UFT automation toolMust have experience with scripting languages such as VBScript, and Test Rail for test lifecycle managementExperience working with the Agile...

  • Test automation lead

    1 week ago

    Bangalore, India Tech Mahindra Full time

    Experience: 6-11 years Location: Bangalore Key Responsibilities: • Design, develop, and maintain automation frameworks for Android and i OS applications using Python and Appium. • Perform log analysis and debugging on Android and i OS using tools like adb and Xcode Instruments. • Test Wi-Fi connectivity and troubleshoot protocol-specific...

  • Test Automation Lead

    2 weeks ago

    Bangalore, India Tech Mahindra Full time

    Experience: 6-11 years Location: Bangalore Key Responsibilities: • Design, develop, and maintain automation frameworks for Android and iOS applications using Python and Appium. • Perform log analysis and debugging on Android and iOS using tools like adb and Xcode Instruments. • Test Wi-Fi connectivity and troubleshoot protocol-specific...