SDET III – Generative AI QA

19 hours ago

Pacific Remote Islands Marine National Monument, India NETomi Full time

About the Company:

Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world's largest global brands do business? Join us

We're seeking a Senior SDET with expertise in Generative AI testing to lead the development of cutting-edge automation frameworks for AI/ML-powered applications. You'll ensure the reliability, safety, and scalability of LLM-driven products while advancing traditional test automation for cloud-native systems.

Responsibilities

  • AI-Aware Test Automation - Design and maintain Python/Java-based automation frameworks (Selenium, Playwright, TestNG/JUnit) for web, API, and backend services.

  • Extend frameworks to test LLM integrations (OpenAI, HuggingFace, RAG pipelines) with prompt validation, hallucination checks, and response consistency tests.

  • Implement model benchmarking (latency, accuracy, bias/drift detection) for generative AI features.

  • Quality Infrastructure - Integrate tests into CI/CD pipelines (Jenkins, GitHub Actions) with cloud workflows (AWS/GCP).

  • Optimize performance testing (JMeter/Locust) for AI endpoints handling high-throughput inference.

  • Debug flaky tests in (non-deterministic) AI systems.

  • Leadership & Innovation - Mentor junior engineers on AI testing best practices.

  • Research tools like LangChain, synthetic data generators, or adversarial testing techniques.

  • Advocate for ML-specific quality metrics beyond traditional pass/fail.
Requirements
  • 7–9 years in QA automation with strong Python/Java proficiency.
  • Hands-on experience with Selenium, Playwright, REST Assured, and CI/CD tools (Jenkins, Docker).
  • Solid understanding of SQL/NoSQL databases and cloud platforms (AWS/GCP).
  • Exposure to performance testing (JMeter, K6) and scalable test frameworks.
  • Experience with LLM testing (prompt engineering, output validation, rubric-based grading).
  • Familiarity with OpenAI APIs, HuggingFace, or LangChain.
  • Knowledge of synthetic test data generation for edge-case scenarios.
  • Autonomy – Thrive in fast-paced, AI-driven environments with minimal supervision.
  • Analytical Mindset – Debug complex failures in probabilistic AI systems.
  • Communication - Explain technical trade-offs to non-technical stakeholders.

Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

  • SDET III – Generative AI QA

    2 weeks ago

    Remote, India NETomi Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the Company:Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and...

  • sdet

    20 hours ago

    Pacific Remote Islands Marine National Monument, India The Design5 Company Full time

    Job Title: SDET (Software Development Engineer in Test)Location: RemoteSalary: ₹70,000 per monthApplication: LinkedIn (Mandatory)NOTE: (Hyderabad candidates, DO NOT APPLY) About the Role:We are looking for a seasoned SDET to drive test automation and ensure the highest quality of our products. If you're passionate about automation, continuous integration,...

  • SDET Intern

    21 hours ago

    Pacific Remote Islands Marine National Monument, India Sprinto Full time

    Sprinto is a leading platform that automates information security compliance. By raising the bar on information security, Sprinto ensures compliance, healthy operational practices, and the ability for businesses to grow and scale with unwavering confidence. We are a team of 300+ employees & helping 2000+ Customers across 75+ Countries. We are funded by top...

  • SDET – Playwright Automation Tester

    21 hours ago

    Pacific Remote Islands Marine National Monument, India Innova Software Services Inc. Full time

    Job Title: SDET – Playwright Automation Tester Location: Remote (Global) Job Type: Full-Time | Permanent Industry: SaaS | Enterprise Software | AI Function: Quality Engineering | Test Automation | Software Engineering Role Overview We're looking for a SDET – Playwright Automation Tester to join our remote-first engineering team. You'll play a critical...

  • Generative AI Engineer

    22 hours ago

    Pacific Remote Islands Marine National Monument, India Etaclam Techno Services Full time

    Job Title: Generative AI EngineerExperience: 6 to 10 YearsLocation: Hybrid (Bangalore, Pune, Mumbai, Hyderabad, Noida)Working Hours: 11:00 AM – 8:00 PM ISTBudget: Up to ₹1.9 Lakhs per MonthEmployment Type: Full-time Job Summary: We are seeking a highly skilled Generative AI Engineer with strong expertise in Python programming to join our growing AI/ML...

  • QA Intern

    19 hours ago

    Pacific Remote Islands Marine National Monument, India BeSpoke AI Stylist Pvt Ltd Full time

    About the Role: We are looking for a motivated and detail-oriented QA Intern to join our Quality Assurance team. As a QA Intern, you will assist in ensuring the quality and functionality of our products through manual and automated testing. This internship is an excellent opportunity to gain hands-on experience in software testing, bug tracking, and QA...

  • computer vision& Gen AI Intern

    20 hours ago

    Pacific Remote Islands Marine National Monument, India Crowd4Test Full time

    Job Title: Computer Vision & GenAI Intern Location: (Remote/On-site/Hybrid ) Duration: 3–6 Months (with possibility of full-time offer) Experience Level: 0–1 Year / Fresh Graduate About Us We are an ambitious QA automation startup building the next generation of AI-powered testing systems. Our mission is to combine computer vision and Generative AI to...

  • Senior Salesforce QA Engineer

    21 hours ago

    Pacific Remote Islands Marine National Monument, India Ranya Infotech Pty Ltd Full time

    We are looking for a Senior QA resource to join our team on a full-time basis (40 hours per week).Role OverviewThe ideal candidate will be an experienced QA professional with strong skills in automated testing, test case design, and test data creation. In addition, the candidate should be comfortable leveraging AI-powered tools to accelerate testing...

  • Principal Generative AI Engineer

    22 hours ago

    Pacific Remote Islands Marine National Monument, India BigR Full time

    Job Title: Principal Generative AI EngineerLocation: Hybrid – Remote (India-based) with onsite every Thursday in Chennai- Travel cost will be reimbursedIndustry: AI/ML, Enterprise Applications, Healthcare About BigRio: BigRio is a Boston-based, remote-first technology consulting firm known for solving complex data and AI challenges. We partner with...

  • Lead Generative AI Engineer

    21 hours ago

    Pacific Remote Islands Marine National Monument, India BigR Full time

    Job Title: Lead Generative AI EngineerLocation: Hybrid – Remote (India-based) with onsite every Thursday in Chennai- Travel cost will be reimbursedIndustry: AI/ML, Enterprise Applications, Healthcare About BigRio: BigRio is a Boston-based, remote-first technology consulting firm known for solving complex data and AI challenges. We partner with...