▷ (Only 24h Left) Gen AI Engineering in Test

2 days ago

Hyderabad India Viraaj HR Solutions Private Limited Full time

Job Description Primary Title: Generative AI Engineer in Test Industry & Sector: Operating in the Enterprise Artificial Intelligence and Quality Engineering sector, delivering production-grade generative-AI features, LLM-driven services, and automated validation frameworks for enterprise customers. We build robust evaluation and test automation to ensure safe, reliable, and scalable AI deployments across mission-critical domains. About The Opportunity We are hiring an on-site Generative AI Engineer in Test to join a fast-paced engineering organisation that embeds testing and quality practices into the ML/GenAI lifecycle. You will design, implement, and operate test automation and evaluation pipelines that validate model behavior, prompt robustness, safety, and integration with cloud services. Role & Responsibilities - Design and implement automated test suites for generative models: unit, integration, regression, and adversarial tests focused on hallucination, bias, safety, and output consistency. - Build and maintain prompt-evaluation frameworks and metric-driven validators for response quality, factuality, and latency across LLM endpoints. - Integrate model tests into CI/CD pipelines to enable pre-release gating, canary evaluations, and automated rollback criteria. - Create reproducible test harnesses for model fine-tuning runs, inference endpoints, and vector-search workflows; automate data generation and evaluation artifacts. - Develop observability and alerting for model drift, performance regressions, and test flakiness; collaborate with SRE/ML engineers to remediate root causes. - Document testing playbooks, establish test-data management practices, and mentor engineering teams on GenAI QA best practices. Skills & Qualifications Must-Have - Proven experience testing ML/LLM systems and implementing test automation. - Strong Python coding for test harnesses and automation scripts. - Hands-on with PyTest or equivalent testing frameworks. - Experience in prompt engineering and prompt robustness evaluation. - Familiarity with LangChain or similar orchestration libraries. - Practical experience integrating tests into CI/CD (Jenkins, GitHub Actions, or equivalent). Preferred - Experience with OpenAI API and Hugging Face transformers / inference tooling. - Containerisation experience with Docker and orchestration familiarity (Kubernetes desirable). - Knowledge of vector databases and retrieval-evaluation patterns (FAISS, Pinecone, etc.). Qualifications - Relevant engineering degree or equivalent hands-on experience in software/ML testing. - 3+ years in test automation or quality engineering with at least 1+ years working on ML/AI model validation preferred. Location & Workplace On-site role India. Candidates must be willing to work from the designated office location. Benefits & Culture Highlights - Collaborative, engineering-first culture with strong emphasis on learning and technical ownership. - Competitive compensation with performance-linked incentives and learning budget for conferences/certifications. - Opportunity to shape GenAI QA practices and influence production-grade AI deployments. To apply, please submit your resume and examples of test frameworks, evaluation scripts, or repos demonstrating GenAI testing experience. This role is sourced by Viraaj HR Solutions and is an on-site opportunity across India. Skills: python,gen ai,testing,gen ai engineering,docker,api testing

  • Gen AI Testing

    6 days ago

    Bengaluru, Chennai, Hyderabad, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systemsCreate and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracyTest model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety...

  • Gen Ai Developer

    3 weeks ago

    Hyderabad, India Whatjobs IN C2 Full time

    Dear Aspirant , Greetings from TCS ! TCS presents excellent opportunity for Gen AI Developer Exp: 4 - 10 Years Job Location: Chennai / Bangalore / Hyderabad / Mumbai / Pune / Kolkata / Delhi / Noida / Gurgaon Gen AI Developer ( Gen AI / LLM /Agentic AI ) Strong programming skills in Python with experience in building ML/NLP applications. Hands-on experience...

  • ▷ Only 24h Left! AI ML Engineer

    2 days ago

    Bengaluru, India Unilog Full time

    Job Description About Unilog Unilog is the only connected product content and eCommerce provider serving the Wholesale Distribution, Manufacturing, and Specialty Retail industries. Our flagship CX1 Platform is at the center of some of the most successful digital transformations in North America. CX1 Platform's syndicated product content, integrated eCommerce...

  • Gen AI Engineer

    2 weeks ago

    India Greymatter Innovationz Full time

    Position: Gen AI Engineer / Jr. ConsultantLocation: RemoteType: Full-time / Onsite (or specify if hybrid/remote)Job Summary:We are seeking a Gen AI Engineer / Junior Consultant with hands-on experience in building, deploying, and optimizing Generative AI solutions. The ideal candidate will possess strong expertise in LLMs, RAG frameworks, LangChain, and...

  • 15h Left: Gen AI Engineer

    4 weeks ago

    Hyderabad, India Idexcel Full time

    Hello All, Greetings from Idexcel !! Hiring Gen AI Engineers ,Below is the detailed JD Job Description Gen AI Engineer – Gen AI Engineering Responsibilities - Contribute to building AI-powered workflows end-to-end, finding the right balance between research and development - Contribute to designing and implementing generative AI solutions using AWS Bedrock...

  • Contract - GEN AI Engineer

    7 days ago

    Hyderabad, Telangana, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About ClientOur client is global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies. Powered by more than 84,000 entrepreneurial professionals across more than 30 countries it covers to over 700 clients. With its extensive domain and technology...

  • Head Of Gen Ai Technology

    7 days ago

    Hyderabad, India Whatjobs IN C2 Full time

    About US Tech Solutions US Tech Solutions is a leading IT services, talent solutions, and HR Tech SaaS platform company. We are driving digital transformation for enterprises by leveraging cutting-edge technologies and delivering talent-driven business solutions. As we scale into the next phase of growth, we are building an AI Factory to power innovation...

  • Only 24h Left: Graphic Designer in Ahmedabad

    4 weeks ago

    Ahmedabad, India Left of Centre Marketing Full time

    Job Description Key Responsibilities - Collaborate with the team to ensure consistency of designs across various media outlets - Create compelling and effective logos, designs, print, and digital media - Maintain awareness of current industry and technology standards, social media, competitive landscape, and market trends About Company: Left Of Centre...

  • Gen AI Engineer

    4 weeks ago

    Hyderabad, India Idexcel Full time

    Hello All, Greetings from Idexcel !! Hiring Gen AI Engineers ,Below is the detailed JD Job Description Gen AI Engineer – Gen AI Engineering Responsibilities Contribute to building AI-powered workflows end-to-end, finding the right balance between research and development Contribute to designing and implementing generative AI solutions using AWS Bedrock...

  • GEN AI Engineer

    3 days ago

    Hyderabad, Telangana, India Motivity Labs Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are hiring a Senior AI/ML & Gen AI Engineer with expertise in AWS Bedrock, AWS Nova, LLMs,RAG, and Agentic AI architectures. This role will focus on AI model development, MLOps, Gen AIsolutions, and AI-first innovation initiatives. The ideal candidate will work on PoCs, accelerators,and AI-driven solutions while mentoring freshers and growing our AI...