SDET III – Generative AI QA

3 weeks ago

Gurugram, India Netomi Full time

About The Company
Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world's largest global brands do business? Join us

We're seeking a Senior SDET with expertise in Generative AI testing to lead the development of cutting-edge automation frameworks for AI/ML-powered applications. You'll ensure the reliability, safety, and scalability of LLM-driven products while advancing traditional test automation for cloud-native systems.

Responsibilities

  • AI-Aware Test Automation - Design and maintain Python/Java-based automation frameworks (Selenium, Playwright, TestNG/JUnit) for web, API, and backend services.
  • Extend frameworks to test LLM integrations (OpenAI, HuggingFace, RAG pipelines) with prompt validation, hallucination checks, and response consistency tests.
  • Implement model benchmarking (latency, accuracy, bias/drift detection) for generative AI features.
  • Quality Infrastructure - Integrate tests into CI/CD pipelines (Jenkins, GitHub Actions) with cloud workflows (AWS/GCP).
  • Optimize performance testing (JMeter/Locust) for AI endpoints handling high-throughput inference.
  • Debug flaky tests in (non-deterministic) AI systems.
  • Leadership & Innovation - Mentor junior engineers on AI testing best practices.
  • Research tools like LangChain, synthetic data generators, or adversarial testing techniques.
  • Advocate for ML-specific quality metrics beyond traditional pass/fail.

Requirements

  • 7–9 years in QA automation with strong Python/Java proficiency.
  • Hands-on experience with Selenium, Playwright, REST Assured, and CI/CD tools (Jenkins, Docker).
  • Solid understanding of SQL/NoSQL databases and cloud platforms (AWS/GCP).
  • Exposure to performance testing (JMeter, K6) and scalable test frameworks.
  • Experience with LLM testing (prompt engineering, output validation, rubric-based grading).
  • Familiarity with OpenAI APIs, HuggingFace, or LangChain.
  • Knowledge of synthetic test data generation for edge-case scenarios.
  • Autonomy – Thrive in fast-paced, AI-driven environments with minimal supervision.
  • Analytical Mindset – Debug complex failures in probabilistic AI systems.
  • Communication - Explain technical trade-offs to non-technical stakeholders.

Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

  • Sdet Iii Manual

    2 weeks ago

    Gurugram, Haryana, India Skeps Full time

    Skeps, a blockchain-based tech company, offers the first microservices platform embedding financial solutions into customer journeys. Our innovative multi-lender POS financing solution simplifies lending for high-value purchases, integrating seamlessly into merchant websites, stores, and omnichannel checkouts, reducing purchase friction and boosting lifetime...

  • (High Salary) SDET QA

    7 days ago

    Gurugram, Gurugram, India Datum Technologies Group Full time

    Job Description Role: SDET QA Location: Chennai, Gurugram, Mumbai Work Mode: Hybrid Key Responsibilities - Design, develop, and maintain automated test frameworks for web, API, and cloud-based applications. - Perform API testing using tools/frameworks such as Postman, RestAssured, or similar. - Write Python-based automation scripts to validate...

  • QA Sdet

    6 days ago

    Gurugram, Haryana, India HTD Resources Full time

    **Position: QA SDET** **Exp: 3-6 Years** **Mode: Hybrid-3/4 Days** **NP: Only Immediate** **Mandatory Skills: API Testing** **Skill Matrix: SDET** **Responsibilities**: - Design software and make technology choices across the stack. - Understand a range of Tier-1 systems/services that power our organization to make scalable changes to critical path...

  • QA Sdet

    2 weeks ago

    Gurugram, Haryana, India HTD Resources Full time

    **Position**:QA SDET **Exp**:3-6 Years **CTC**: 5 - 10 LPA **Location**: Gurgaon **Mode: Hybrid-3/4 Days** **NP: Only Immediate** **Responsibilities**: - Design software and make technology choices across the stack. Understand a range of Tier-1 - systems/services that power BharatPe to make scalable changes to critical path code. - Contributing...

  • QA Engineer III

    1 week ago

    Gurugram, India Insight Enterprises Full time

    Requisition Number:   QA Engineer III Location: The role will be a hybrid/remote position located in India- Delhi NCR/Hyderabad/Bangalore/Pune/Mumbai/Chennai Insight at a Glance 14,000+ engaged teammates globally #20 on Fortune’s World's Best Workplaces list $9.2 billion in revenue Received 35+ industry and partner awards in the past year $1.4M+...

  • QA Engineer III

    1 week ago

    Gurugram, India Insight Enterprises Full time

    Requisition Number:   QA Engineer III Location: The role will be a hybrid/remote position located in India- Delhi NCR/Hyderabad/Bangalore/Pune/Mumbai/Chennai Insight at a Glance 14,000+ engaged teammates globally #20 on Fortune’s World's Best Workplaces list $9.2 billion in revenue Received 35+ industry and partner awards in the past...

  • Sdet-ii-mobile

    4 days ago

    Gurugram, Haryana, India Deutsche Telekom Digital Labs Full time

    **SDET-II-Mobile**: **FTE** - Job Code: DTDLPL-81122 | Deutsche Telekom Digital Labs Private LimitedGurugram, Haryana, India Expires on 30/07/2025- Required Experience**4 - 6 Years** - Skills**Core java,** **Java,** **appium** **Responsibilities**: - Design, build, and maintain efficient and reliable Java code - Develop Java web services in a fast-paced...

  • Sdet - 1

    4 days ago

    Gurugram, Haryana, India Innorenovate Full time

    A Bachelor's degree in Computer Science, Computer Engineering, or a related field. - 1.5 - 7 years of experience in QA and test automation - Good in at least one of the programming languages - Good in problem-solving, DS, and algorithms - Good knowledge of the open-source test automation framework/tool - Hands-on experience with DB (SQL, NoSQL) and...

  • [Only 24h Left] Generative AI Developer

    2 weeks ago

    Gurugram, Gurugram, India Birbal AI Full time

    Job Description Were looking for a skilled Generative AI Developer to build agentic AI solutions using Dify.ai or similar platforms (LangChain, LlamaIndex, Haystack). Youll design and implement intelligent, autonomous AI agents and workflows that solve real business problems. Key Responsibilities - Develop agentic AI workflows with Dify.ai, LangChain, or...

  • Lead SDET

    1 week ago

    Gurugram, India Aeris Full time

    About Aeris: For more than three decades, Aeris has been a trusted cellular IoT leader enabling the biggest IoT programs and opportunities across Automotive, Utilities and Energy, Fleet Management and Logistics, Medical Devices, and Manufacturing. Our IoT technology expertise serves a global ecosystem of 7,000 enterprise customers and 30 mobile network...