Gen AI Tester

2 weeks ago

Hyderabad, Telangana, India Talent Worx Full time ₹ 5,00,000 - ₹ 15,00,000 per year

Gen AI Tester

Job Title: Generative AI Tester
Experience: 3+ years / 6+ years

Job Description:
We are seeking a detail-oriented Generative AI Tester to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). This role focuses on testing prompt responses, evaluating edge cases, and ensuring AI outputs align with business and compliance standards.

Key Responsibilities:

  • Design and execute test cases for Gen AI features and conversational workflows.
  • Validate outputs of LLMs for accuracy, relevance, coherence, and safety.
  • Conduct prompt testing, fine-tuning evaluation, and edge-case scenario validation.
  • Collaborate with AI engineers, product managers, and QA teams to improve test coverage and feedback loops.
  • Document defects, issues, and improvement areas using tools like JIRA or similar.
  • Evaluate AI systems against ethical and fairness benchmarks.

Requirements:

  • 2+ years of experience in QA/testing, with exposure to AI/ML or NLP systems.
  • Familiarity with LLMs (e.g., GPT, Claude, or open-source alternatives).
  • Strong analytical and critical thinking skills for non-deterministic system testing.
  • Experience with test management tools and basic scripting (Python preferred).
  • Good understanding of prompt engineering and model evaluation principles.

Preferred Qualifications:

  • Experience in testing conversational AI, chatbots, or virtual assistants.
  • Understanding of responsible AI practices, including bias and hallucination detection.
  • Exposure to RAG (Retrieval-Augmented Generation) pipelines and vector databases.

  • Gen AI Engineer

    4 days ago

    Hyderabad, Telangana, India Idexcel Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hello All,Greetings from Idexcel Hiring Gen AI Engineers ,Below is the detailed JDJob DescriptionGen AI Engineer – Gen AI EngineeringResponsibilitiesContribute to building AI-powered workflows end-to-end, finding the right balance between research and developmentContribute to designing and implementing generative AI solutions using AWS Bedrock foundation...

  • Gen AI Professional

    6 days ago

    Hyderabad, Telangana, India Virtusa Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Primary skills :Gemini Agent space, AI multi cloud experience, Experience in running AI services, vibe coding(Cursor), VertexSecondary skills :Terraform, Multi cloud experience (AWS)Excellent programming skills and proficiency in at least one of the major programming scripting languages used in Gen AI orchestration such as Python or PySpark or JavaHands on...

  • AI ML Gen AI Engineer

    4 hours ago

    Hyderabad, Telangana, India Motivity Labs Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Location: Hyderabad (WFO)Experience: 6-8 YearsJob Type: Full-time Role Overview:We are hiring aSenior AI/ML & Gen AI Engineerwith expertise inAWS Bedrock, AWS Nova, LLMs, RAG, and Agentic AI architectures. This role will focus onAI model development, MLOps, Gen AI solutions, and AI-first innovation initiatives. The ideal candidate will work onPoCs,...

  • Gen AI Developer

    9 hours ago

    Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Gen AI DeveloperLocation:Pan India (Hybrid/Remote flexibility may vary by project)Experience:6–9 Years (STRICTLY)Employment Type:PermanentNotice Period:Up to 30 DaysCTC:Based on experience and fitmentAbout the CompanyOur client is a global leader in IT and digital services, operating in 50+ countries. They focus on cutting-edge technologies...

  • Head of Gen AI Technology

    1 week ago

    Hyderabad, Telangana, India US Tech Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About US Tech SolutionsUS Tech Solutions is a leading IT services, talent solutions, and HR Tech SaaS platform company. We are driving digital transformation for enterprises by leveraging cutting-edge technologies and delivering talent-driven business solutions. As we scale into the next phase of growth, we are building anAI Factoryto power innovation across...

  • GEN AI Engineer

    7 days ago

    Hyderabad, Telangana, India Metasys Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role:Gen AI Engineer / AI Solution DeveloperLocation:Hyderabad / Bangalore / NoidaExperience:5+ YearsObjective:Develop an AI solution for generating technical documentation by understanding natural language, interpreting code, and producing detailed technical responses.Required Skills:Python with GitLLMs / SLMs (Transformer architecture, fine-tuning)AI...

  • Contract - GEN AI Engineer

    9 hours ago

    Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About ClientOur client is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients. With its extensive domain and technology...

  • GEN AI Lead

    7 days ago

    Hyderabad, Telangana, India Wipro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:We are seeking a highly skilled AI Engineer with deep expertise in Python and advanced AI technologies, including Deep Learning, Large Language Models (LLM), Langchain, Retrieval-Augmented Generation (RAG), and Generative AI. The ideal candidate will have a strong foundation in AI Cognitive systems and a passion for developing cutting-edge AI...

  • Gen AI Engineer

    1 week ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role –Senior Gen AI EngineerLocation: CoimbatoreExperience : 3 Yr to 12 YrJob Description:Collect and prepare data for training and evaluating multimodal foundation models. This may involve cleaning and processing text data or creating synthetic data.Develop and optimize large-scale language models like GANs (Generative Adversarial Networks) and VAEs...

  • Gen AI Engineer

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Gen AI EngineerLocation - ChennaiJob DescriptionCollect and prepare data for training and evaluating multimodal foundation models. This may involve cleaning and processing text data or creating synthetic data.Develop and optimize large-scale language models like GANs (Generative Adversarial Networks) and VAEs (Variational Autoencoders)Work on tasks...