SDET III – Generative AI QA

2 days ago

Gurgaon, Haryana, India Netomi Full time ₹ 12,00,000 - ₹ 24,00,000 per year
About the Company: Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.
Want to be part of the AI revolution and transform how the world's largest global brands do business? Join us
We're seeking a Senior SDET with expertise in Generative AI testing to lead the development of cutting-edge automation frameworks for AI/ML-powered applications. You'll ensure the reliability, safety, and scalability of LLM-driven products while advancing traditional test automation for cloud-native systems. Responsibilities
  • AI-Aware Test Automation - Design and maintain Python/Java-based automation frameworks (Selenium, Playwright, TestNG/JUnit) for web, API, and backend services.
  • Extend frameworks to test LLM integrations (OpenAI, HuggingFace, RAG pipelines) with prompt validation, hallucination checks, and response consistency tests.
  • Implement model benchmarking (latency, accuracy, bias/drift detection) for generative AI features.
  • Quality Infrastructure - Integrate tests into CI/CD pipelines (Jenkins, GitHub Actions) with cloud workflows (AWS/GCP).
  • Optimize performance testing (JMeter/Locust) for AI endpoints handling high-throughput inference.
  • Debug flaky tests in (non-deterministic) AI systems.
  • Leadership & Innovation - Mentor junior engineers on AI testing best practices.
  • Research tools like LangChain, synthetic data generators, or adversarial testing techniques.
  • Advocate for ML-specific quality metrics beyond traditional pass/fail.
Requirements
  • 7–9 years in QA automation with strong Python/Java proficiency.
  • Hands-on experience with Selenium, Playwright, REST Assured, and CI/CD tools (Jenkins, Docker).
  • Solid understanding of SQL/NoSQL databases and cloud platforms (AWS/GCP).
  • Exposure to performance testing (JMeter, K6) and scalable test frameworks.
  • Experience with LLM testing (prompt engineering, output validation, rubric-based grading).
  • Familiarity with OpenAI APIs, HuggingFace, or LangChain.
  • Knowledge of synthetic test data generation for edge-case scenarios.
  • Autonomy – Thrive in fast-paced, AI-driven environments with minimal supervision.
  • Analytical Mindset – Debug complex failures in probabilistic AI systems.
  • Communication - Explain technical trade-offs to non-technical stakeholders.
Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

  • Senior QA SDET

    15 hours ago

    Gurgaon, Haryana, India Airtel Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Senior QA SDET Key Deliverables · You will be creating adequate automation process and implement technical edge in the Airtel Digital Portfolio. · Responsible for end to end backend deliverables, which includes requirement phase, design phase, release process, production monitoring and customer issues debugging. · Continuously improve QA...

  • Sr. SDET

    2 days ago

    Gurgaon, Haryana, India Aeris Communications Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Aeris: For more than three decades, Aeris has been a trusted cellular IoT leader enabling the biggest IoT programs and opportunities across Automotive, Utilities and Energy, Fleet Management and Logistics, Medical Devices, and Manufacturing. Our IoT technology expertise serves a global ecosystem of 7,000 enterprise customers and 30 mobile network...

  • QA Engineer

    3 days ago

    Gurgaon, Haryana, India IndusInd Bank Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description:At IndusInd Bank, we are looking for an Automation QA / SDET Engineer to work with our digital strategy and analytics team, which builds & maintains the digital banking products across web & mobile to deliver the best banking experience to customers.About the Role:Coordinate with internal stakeholders, understand requirements and translate...

  • Software Development Engineer in Test III

    6 days ago

    Gurgaon, Haryana, India S&P Global Full time ₹ 8,00,000 - ₹ 20,00,000 per year

    About the Role:Grade Level (for internal use):10The Role: Software Development Engineer in Test III (SDET III)The Location: Gurgaon/ HyderabadThe Team:The team works in the SAFe agile environment and adheres to all principles of Agile. As Senior SDET, you will work with a team of intelligent, ambitious and results-oriented software professionals. The team is...

  • Qa Tester

    2 weeks ago

    Gurgaon, Haryana, India BB Works Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Position: QA Tester Financial Regulatory Reporting & Compliance (Banking)Experience: 6 to 10 YearsLocation: GurgaonJob Description:We are looking for an experienced QA Tester with strong expertise in Financial Regulatory Reporting and Compliance within the Banking domain. The ideal candidate should have hands-on experience in testing complex financial...

  • Generative AI Engineer

    2 weeks ago

    Gurgaon, Haryana, India BigStep Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Designing and Developing AI models, creating architectures, algorithms, and frameworks for generative AI. - Implementing AI models into existing systems and applications. - Collaborating with teams like data scientists, product managers, and stakeholders. - Testing, deploying, monitoring, and optimizing AI models for...

  • Generative AI Engineer

    2 weeks ago

    Gurgaon, Haryana, India BigStep Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key ResponsibilitiesDesigning and Developing AI models, creating architectures, algorithms, and frameworks for generative AI.Implementing AI models into existing systems and applications.Collaborating with teams like data scientists, product managers, and stakeholders.Testing, deploying, monitoring, and optimizing AI models for performance.Staying updated...

  • Manager - Generative AI

    20 hours ago

    Gurgaon, Haryana, India Novotree Minds Consulting Pvt Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Lead and deliver Generative AI projects from requirements gathering to deployment. - Work hands-on with LLMs, RAG models, LangChain, Hugging Face, OpenAI APIs, and open-source frameworks. - Deploy and manage AI models in cloud-based environments (AWS/Azure/GCP). - Agile project management experience and strong experience...

  • QA Engineer

    2 days ago

    Gurgaon, Haryana, India Leena Ai Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Key Responsibilities and Skills:Strong hands-on experience in creating and executing test cases for APIs, integrations, and system workflows.Working experience with API testing using tools such as Postman, REST Assured, or similar.Solid understanding of manual testing concepts, including test case design, bug leakage, defect lifecycle, and exploratory...

  • Generative AI Architect

    2 weeks ago

    Gurgaon, Haryana, India EXL Service Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Generative AI Architect We are seeking a visionary Generative AI Architect with strong hands-on experience to lead the design and deployment of intelligent solutions leveraging Large Language Models (LLMs), agentic frameworks, and advanced NLP techniques. This role emphasizes deep expertise in LangChain, LangGraph, agentic workflows to build scalable,...