SDET III – Generative AI QA

1 week ago

Remote, India NETomi Full time ₹ 15,00,000 - ₹ 20,00,000 per year

About the Company:

Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world's largest global brands do business? Join us

We're seeking a Senior SDET with expertise in Generative AI testing to lead the development of cutting-edge automation frameworks for AI/ML-powered applications. You'll ensure the reliability, safety, and scalability of LLM-driven products while advancing traditional test automation for cloud-native systems.

Responsibilities

  • AI-Aware Test Automation - Design and maintain Python/Java-based automation frameworks (Selenium, Playwright, TestNG/JUnit) for web, API, and backend services.

  • Extend frameworks to test LLM integrations (OpenAI, HuggingFace, RAG pipelines) with prompt validation, hallucination checks, and response consistency tests.

  • Implement model benchmarking (latency, accuracy, bias/drift detection) for generative AI features.

  • Quality Infrastructure - Integrate tests into CI/CD pipelines (Jenkins, GitHub Actions) with cloud workflows (AWS/GCP).

  • Optimize performance testing (JMeter/Locust) for AI endpoints handling high-throughput inference.

  • Debug flaky tests in (non-deterministic) AI systems.

  • Leadership & Innovation - Mentor junior engineers on AI testing best practices.

  • Research tools like LangChain, synthetic data generators, or adversarial testing techniques.

  • Advocate for ML-specific quality metrics beyond traditional pass/fail.
Requirements
  • 7–9 years in QA automation with strong Python/Java proficiency.
  • Hands-on experience with Selenium, Playwright, REST Assured, and CI/CD tools (Jenkins, Docker).
  • Solid understanding of SQL/NoSQL databases and cloud platforms (AWS/GCP).
  • Exposure to performance testing (JMeter, K6) and scalable test frameworks.
  • Experience with LLM testing (prompt engineering, output validation, rubric-based grading).
  • Familiarity with OpenAI APIs, HuggingFace, or LangChain.
  • Knowledge of synthetic test data generation for edge-case scenarios.
  • Autonomy – Thrive in fast-paced, AI-driven environments with minimal supervision.
  • Analytical Mindset – Debug complex failures in probabilistic AI systems.
  • Communication - Explain technical trade-offs to non-technical stakeholders.

Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

  • SDE III

    1 week ago

    India (Remote) Interface AI Full time US$ 1,25,000 - US$ 1,75,000 per year

    Role – SDE III – Backend AI Location: India (Remote) Function: Engineering – Product Engineering Reports to: Engineering Manager – Product Engineering About the Role We are looking for a Software Development Engineer III to join the team behind Sphere, our flagship conversational AI platform powering intelligent voice and digital...

  • SDE III

    1 week ago

    India (Remote) Interface AI Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role – SDE III (Full Stack) Location: India (Remote) Function: Engineering – Product Engineering Level: Senior Reports to: Engineering Manager – Product Engineering About the Role We're looking for a Full Stack Engineer with frontend experience to join the team that helps users navigate financial services through seamless chat and...

  • sdet

    1 week ago

    Remote, India The Design5 Company Full time ₹ 6,30,000 - ₹ 8,40,000 per year

    Job Title: SDET (Software Development Engineer in Test)Location: RemoteSalary: ₹70,000 per monthApplication: LinkedIn (Mandatory)NOTE: (Hyderabad candidates, DO NOT APPLY)About the Role:We are looking for a seasoned SDET to drive test automation and ensure the highest quality of our products. If you're passionate about automation, continuous integration,...

  • Sdet

    2 days ago

    Remote, India Cornerstone OnDemand, Inc. Full time

    **We're looking for a** **SDET** **In this role you will** - Build high-quality, reliable QA automation to support rapid deployments - Develop QA tooling and infrastructure to help engineering teams measure and increase their velocity. - Collaborate with all disciplines during our agile development cycle to solve complex engineering problems. - Adopt a...

  • Sdet with Pega Gateway

    2 weeks ago

    Remote, India American IT Systems Full time

    **Job Title: SDET/QE Engineer with Pega Gateway Experience** **Duration: long term contract** **Position: Remote (Must be in India)** **Skills**: - SDET- 10-15 years - Selenium experience - C# experience - Pega Gateway experience - API experience - Database experience **Responsibilities**: - Design, develop, and maintain robust automation frameworks...

  • Lead SDET

    5 days ago

    Remote, India HighLevel Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    About HighLevel:HighLevel is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. We are proud to support a global and growing community of over 2 million businesses, comprised of agencies, consultants, and businesses of all sizes and...

  • Sdet Intern

    6 days ago

    Remote, India Sprinto Full time

    **Sprinto** is a leading platform that automates information security compliance. By raising the bar on information security, Sprinto ensures compliance, healthy operational practices, and the ability for businesses to grow and scale with unwavering confidence. We are a team of **300+ employees** & helping **2000+ Customers** across **75+ Countries**. We are...

  • Sdet - Playwright Automation Tester

    6 days ago

    Remote, India Innova Software Services Inc. Full time

    Job Title: SDET - Playwright Automation Tester Location: Remote (Global) **Job Type**: Full-Time | Permanent Industry: SaaS | Enterprise Software | AI Function: Quality Engineering | Test Automation | Software Engineering **Role Overview** We’re looking for a SDET - Playwright Automation Tester to join our remote-first engineering team. You’ll play...

  • SDET Intern

    5 days ago

    Remote, India Sprinto Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Sprinto is a leading platform that automates information security compliance. By raising the bar on information security, Sprinto ensures compliance, healthy operational practices, and the ability for businesses to grow and scale with unwavering confidence. We are a team of 300+ employees & helping 2000+ Customers across 75+ Countries. We are funded by top...

  • SDET with Pega Gateway

    7 days ago

    Remote, India American IT Systems Full time ₹ 25,00,000 - ₹ 30,00,000 per year

    Job Title: SDET/QE Engineer with Pega Gateway ExperienceDuration: long term contractPosition: Remote (Must be in India)Skills:· SDET years· Selenium experience· C# experience· Pega Gateway experience· API experience· Database experienceResponsibilities:· Design, develop, and maintain robust automation frameworks using Selenium and C#.· Implement...