Gen AI Engineering in Test

5 days ago

Hyderabad, Telangana, India viraaj hr solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Primary Title: Generative AI Engineer in Test

Industry & Sector: Operating in the Enterprise Artificial Intelligence and Quality Engineering sector, delivering production-grade generative-AI features, LLM-driven services, and automated validation frameworks for enterprise customers. We build robust evaluation and test automation to ensure safe, reliable, and scalable AI deployments across mission-critical domains.

About the Opportunity

We are hiring an on-site Generative AI Engineer in Test to join a fast-paced engineering organisation that embeds testing and quality practices into the ML/GenAI lifecycle. You will design, implement, and operate test automation and evaluation pipelines that validate model behavior, prompt robustness, safety, and integration with cloud services.

Role & Responsibilities
  • Design and implement automated test suites for generative models: unit, integration, regression, and adversarial tests focused on hallucination, bias, safety, and output consistency.
  • Build and maintain prompt-evaluation frameworks and metric-driven validators for response quality, factuality, and latency across LLM endpoints.
  • Integrate model tests into CI/CD pipelines to enable pre-release gating, canary evaluations, and automated rollback criteria.
  • Create reproducible test harnesses for model fine-tuning runs, inference endpoints, and vector-search workflows; automate data generation and evaluation artifacts.
  • Develop observability and alerting for model drift, performance regressions, and test flakiness; collaborate with SRE/ML engineers to remediate root causes.
  • Document testing playbooks, establish test-data management practices, and mentor engineering teams on GenAI QA best practices.
Skills & Qualifications

Must-Have

  • Proven experience testing ML/LLM systems and implementing test automation.
  • Strong Python coding for test harnesses and automation scripts.
  • Hands-on with PyTest or equivalent testing frameworks.
  • Experience in prompt engineering and prompt robustness evaluation.
  • Familiarity with LangChain or similar orchestration libraries.
  • Practical experience integrating tests into CI/CD (Jenkins, GitHub Actions, or equivalent).

Preferred

  • Experience with OpenAI API and Hugging Face transformers / inference tooling.
  • Containerisation experience with Docker and orchestration familiarity (Kubernetes desirable).
  • Knowledge of vector databases and retrieval-evaluation patterns (FAISS, Pinecone, etc.).
Qualifications
  • Relevant engineering degree or equivalent hands-on experience in software/ML testing.
  • 3+ years in test automation or quality engineering with at least 1+ years working on ML/AI model validation preferred.
Location & Workplace

On-site role — India. Candidates must be willing to work from the designated office location.

Benefits & Culture Highlights
  • Collaborative, engineering-first culture with strong emphasis on learning and technical ownership.
  • Competitive compensation with performance-linked incentives and learning budget for conferences/certifications.
  • Opportunity to shape GenAI QA practices and influence production-grade AI deployments.

To apply, please submit your resume and examples of test frameworks, evaluation scripts, or repos demonstrating GenAI testing experience. This role is sourced by Viraaj HR Solutions and is an on-site opportunity across India.

  • GEN AI Engineer

    2 weeks ago

    Hyderabad, Telangana, India Motivity Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are hiring a Senior AI/ML & Gen AI Engineer with expertise in AWS Bedrock, AWS Nova, LLMs,RAG, and Agentic AI architectures. This role will focus on AI model development, MLOps, Gen AIsolutions, and AI-first innovation initiatives. The ideal candidate will work on PoCs, accelerators,and AI-driven solutions while mentoring freshers and growing our AI...

  • Gen AI

    2 weeks ago

    Hyderabad, Telangana, India GenAILakes Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Gen AI / AI Engineer (Mid-Level)Location: HyderbadJob Description:We are hiring a Gen AI / AI Engineer with 2+ years of experience in building and deploying AI/ML solutions, especially in Generative AI and RAG (Retrieval-Augmented Generation) architectures. You'll work on state-of-the-art models, fine-tuning, and system integration to build...

  • Gen AI Tester

    5 days ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Gen AI TesterJob Title: Generative AI Tester Experience: 3+ years / 6+ yearsJob Description: We are seeking a detail-oriented Generative AI Tester to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). This role focuses on testing prompt responses, evaluating edge cases, and ensuring AI outputs align...

  • Gen AI

    1 week ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    MLE Responsibilities Design, implement, and maintain back-end API endpoints to support Gen AI and RAG (Retrieval-Augmented Generation) applications. Manage and optimize chat history storage in DynamoDB, ensuring scalability and efficient retrieval. Develop and test integrations with front-end UI components for seamless user experience. (React and...

  • GEN AI Engineer

    1 week ago

    Hyderabad, Telangana, India Techno Facts Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description:Designation : GEN AI EngineerShift Time:- 2 to 11 PM ISTRole OverviewWe are seeking a highly skilled and visionary GEN AI and Implementor to lead the design, development, and deployment of advanced AI/ML solutions across Retail Analytics Engineering Platforms. This role demands deep expertise in Generative AI, LLMs, Agentic AI, and MLops...

  • Gen AI

    1 week ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 10,00,000 - ₹ 15,00,000 per year

    Gen AIWe are seeking a skilled and motivated AI Engineer to join our dynamic team. The ideal candidate will have 2 to 4 years of experience in developing and deploying Gen AI and AI/ML solutions to production. This requires hands-on experience with no code, low code, and SDKs to build AI systems. The candidate should be proficient in working with data...

  • GEN AI Engineer

    19 hours ago

    Hyderabad, Telangana, India Metasys Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role:Gen AI Engineer / AI Solution DeveloperLocation:Hyderabad / Bangalore / NoidaExperience:5+ YearsObjective:Develop an AI solution for generating technical documentation by understanding natural language, interpreting code, and producing detailed technical responses.Required Skills:Python with GitLLMs / SLMs (Transformer architecture, fine-tuning)AI...

  • Gen AI

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Gen AIWe are looking for seeking a skilled and motivated AI Engineer to join our dynamic team. The ideal candidate will have 2 to 4 years of experience in developing and deploying GenAI and AI/ML solutions to production. This requires hands-on experience with no code, low code, and SDKs to build AI systems. The candidate should be proficient in working with...

  • Gen AI

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 10,000 - ₹ 50,000 per year

    Primary skills \: Gemini Agent space, AI multi cloud experience, Experience in running AI services, vibe coding(Cursor), VertexSecondary skills \: Terraform, Multi cloud experience (AWS) Excellent programming skills and proficiency in at least one of the major programming scripting languages used in Gen AI orchestration such as Python or PySpark or...

  • Head of Gen AI Technology

    3 days ago

    Hyderabad, Telangana, India US Tech Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About US Tech SolutionsUS Tech Solutions is a leading IT services, talent solutions, and HR Tech SaaS platform company. We are driving digital transformation for enterprises by leveraging cutting-edge technologies and delivering talent-driven business solutions. As we scale into the next phase of growth, we are building anAI Factoryto power innovation across...