SDET III – Generative AI QA

19 hours ago

Gurugram, India Netomi Full time

About The Company
Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world's largest global brands do business? Join us

We're seeking a Senior SDET with expertise in Generative AI testing to lead the development of cutting-edge automation frameworks for AI/ML-powered applications. You'll ensure the reliability, safety, and scalability of LLM-driven products while advancing traditional test automation for cloud-native systems.

Responsibilities

  • AI-Aware Test Automation - Design and maintain Python/Java-based automation frameworks (Selenium, Playwright, TestNG/JUnit) for web, API, and backend services.
  • Extend frameworks to test LLM integrations (OpenAI, HuggingFace, RAG pipelines) with prompt validation, hallucination checks, and response consistency tests.
  • Implement model benchmarking (latency, accuracy, bias/drift detection) for generative AI features.
  • Quality Infrastructure - Integrate tests into CI/CD pipelines (Jenkins, GitHub Actions) with cloud workflows (AWS/GCP).
  • Optimize performance testing (JMeter/Locust) for AI endpoints handling high-throughput inference.
  • Debug flaky tests in (non-deterministic) AI systems.
  • Leadership & Innovation - Mentor junior engineers on AI testing best practices.
  • Research tools like LangChain, synthetic data generators, or adversarial testing techniques.
  • Advocate for ML-specific quality metrics beyond traditional pass/fail.

Requirements

  • 7–9 years in QA automation with strong Python/Java proficiency.
  • Hands-on experience with Selenium, Playwright, REST Assured, and CI/CD tools (Jenkins, Docker).
  • Solid understanding of SQL/NoSQL databases and cloud platforms (AWS/GCP).
  • Exposure to performance testing (JMeter, K6) and scalable test frameworks.
  • Experience with LLM testing (prompt engineering, output validation, rubric-based grading).
  • Familiarity with OpenAI APIs, HuggingFace, or LangChain.
  • Knowledge of synthetic test data generation for edge-case scenarios.
  • Autonomy – Thrive in fast-paced, AI-driven environments with minimal supervision.
  • Analytical Mindset – Debug complex failures in probabilistic AI systems.
  • Communication - Explain technical trade-offs to non-technical stakeholders.

Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

  • QA Sdet

    2 weeks ago

    Gurugram, Haryana, India HTD Resources Full time

    **Position: QA SDET** **Exp: 3-6 Years** **Mode: Hybrid-3/4 Days** **NP: Only Immediate** **Mandatory Skills: API Testing** **Skill Matrix: SDET** **Responsibilities**: - Design software and make technology choices across the stack. - Understand a range of Tier-1 systems/services that power our organization to make scalable changes to critical path...

  • QA - Sdet (Manual & Automation)

    6 days ago

    Gurugram, Haryana, India ixigo Full time

    **Company Description** ConfirmTkt and AbhiBus became a part of ixigo in 2021. ixigo is headquartered in Gurugram with offices in Bangalore (ConfirmTkt) and Hyderabad (AbhiBus). The ixigo, ConfirmTkt and AbhiBus apps allow travellers to book train tickets, flight tickets, bus tickets, hotels, cabs and provide travel utility tools and services developed using...

  • Sdet - 1

    2 weeks ago

    Gurugram, Haryana, India Innorenovate Full time

    A Bachelor's degree in Computer Science, Computer Engineering, or a related field. - 1.5 - 7 years of experience in QA and test automation - Good in at least one of the programming languages - Good in problem-solving, DS, and algorithms - Good knowledge of the open-source test automation framework/tool - Hands-on experience with DB (SQL, NoSQL) and...

  • Sdet-ii-mobile

    2 weeks ago

    Gurugram, Haryana, India Deutsche Telekom Digital Labs Full time

    **SDET-II-Mobile**: **FTE** - Job Code: DTDLPL-81122 | Deutsche Telekom Digital Labs Private LimitedGurugram, Haryana, India Expires on 30/07/2025- Required Experience**4 - 6 Years** - Skills**Core java,** **Java,** **appium** **Responsibilities**: - Design, build, and maintain efficient and reliable Java code - Develop Java web services in a fast-paced...

  • Sdet 1 (Automation)

    5 days ago

    Gurugram, Haryana, India GoKwik Commerce Solutions Pvt. Ltd. Full time

    **Who We Are as a Company**: GoKwik was founded in 2020 with one simple mission, to democratise the shopping experience and increase the GMV realisation for e-commerce businesses. The company is backed by Sequoia Capital India, Matrix Partners India, RTP Global, and marquee angels. GoKwik is an e-commerce enablement company focussed predominantly on solving...

  • Generative AI

    18 hours ago

    Gurugram, India Branding Pioneers Full time

    Company Description Branding Pioneers is committed to helping healthcare providers deliver top-notch patient experiences from the moment they are found online. As digital marketing specialists, we create patient-friendly and fully-responsive solutions that align with your practice values. Our custom platforms ensure a positive impression on patients,...

  • Senior SDET

    20 hours ago

    Gurugram, India Simpplr Full time

    Who We AreSimpplr is the AI-powered platform that unifies the digital workplace – bringing together engagement, enablement, and services to transform the employee experience. It streamlines communication, simplifies interactions, automates workflows, and elevates the everyday experience of work. The platform is intuitive, highly extensible, and built to...

  • Generative AI

    19 hours ago

    Gurugram, India Office Solutions Full time

    Responsibilities: * Develop generative AI models using ML, Python & SQL. * Optimize performance through data science techniques. * Implement RAGB for improved retrieval accuracy. must have GEN AI LLM RAG Python SQL Vector DB Provident fundAnnual bonus

  • Generative AI Specialist

    20 hours ago

    Gurugram, India CogentHubCX Full time

    Job Description Generative AI Specialist About the Role We are seeking innovative, enthusiastic, and versatile AI professionals to join our global team as Generative AI Specialists. In this role, you will drive transformation across the ITeS/BPO industry, working on complex projects that blend strategic business insights with advanced data science...

  • Sr. SDET Engineer

    19 hours ago

    Gurugram, India zKonsult Innovative Solutions Private Limited (ZISPL) Full time

    Job Title: Sr. SDET Engineer Location: Gurugram Mandate Skills: C#, Playwright, Appium Job Description: Design, develop, and maintain automated test scripts using  C# or Java ,  Playwright , and  SpecFlow . Lead the automation efforts for web-based applications, ensuring robust and efficient testing using tools like  Playwright  and  Appium . Automate...