Gen AI Validation Engineer

2 weeks ago

Hyderabad, Telangana, India S&P Global Market Intelligence Full time ₹ 15,00,000 - ₹ 25,00,000 per year

About the Role:

*The Team:*

A part of Ratings Technology, the Ratings QA team leads the IT organization in the delivery of trusted quality to our users. From a foundation of disciplined processes, QA seeks out innovative testing solutions, reliable & transparent test execution, and aspires towards continuous improvement in achieving top quality.

In close partnership with Product Management and Product Engineering, QA team members help drive quality accountability, and work to ensure our end users receive reliable, stable, defect free products, which help confidently execute our business and elevate our products.

*Responsibilities:*

  • Responsible for certifying applications that integrate Generative AI models & workflows
  • Validate the functionalities of the In-House Generative AI platform that serves models to internal users.
  • Ensure high-quality standards and performance of applications without involvement in model evaluations.
  • Develop automation/performance scripts that meet organization standards and build reliable, reusable and maintainable automated regression suites & test harness
  • Leverage tools and frameworks to build automation/performance scripts with quality code to simplify testing scenarios
  • Work in an Agile environment and adhere to all QA best practices.
  • Work in partnership with Scrum team members, including engineering and product management, to deliver business functionality on-time, with required quality, and that meets the acceptance criteria
  • Write test cases and scenarios from the requirements/designs; manage bug tracking.
  • Trigger, monitor and control the execution of automated test suites, identifying issues and potential gaps.
  • Support QA governance of test processes, data, and execution metrics to help drive improve the performance of team.
  • Perform risk analysis for features/projects in your ownership, provide mitigation and escalate appropriately.
  • Collaborate effectively with technical and non-technical stakeholders to analyze, debug and resolve any issues.

*Basic Qualifications*

  • 6 to 10 years experience in certifying complex business applications workflows
  • 1-2 years of experience exposure in working with Generative AI applications
  • Exposure or awareness of LLM model evaluations
  • Practitioner level understanding of prompt engineering
  • Strong hands-on coding/scripting experience in automation testing & engineering programming using Python/Java languages.
  • Experience in design and development of automated tests using automation tool (e.g., Python, Selenium) across the application layers (UI/Service/Data layers) and root cause analysis.
  • Experience of working with REST services
  • Exposure to distributed source control systems such as Git
  • Excellent problem solving, analytical and technical troubleshooting skills.
  • Experience of testing in CI/CD/CT, Azure DevOps model.
  • In depth usage and creation of automation framework for testing JSON, Rest/SOAP based web services
  • Bachelor's or higher qualification in Computer Science, Information Systems or equivalent is preferred.
  • Knowledge of testing in continuous integration/DevOps models is a plus.
  • Understanding of Cloud technologies like AWS/Azure and micro-services, containers integration testing will be added advantage.

*Shift time: 12pm to 9pm IST*

*Hybrid Model: twice a week work from office.*

  • Gen AI Tester

    1 week ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Gen AI TesterJob Title: Generative AI Tester Experience: 3+ years / 6+ yearsJob Description: We are seeking a detail-oriented Generative AI Tester to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). This role focuses on testing prompt responses, evaluating edge cases, and ensuring AI outputs align...

  • Gen AI Engineer

    4 days ago

    Hyderabad, Telangana, India Idexcel Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hello All,Greetings from Idexcel Hiring Gen AI Engineers ,Below is the detailed JDJob DescriptionGen AI Engineer – Gen AI EngineeringResponsibilitiesContribute to building AI-powered workflows end-to-end, finding the right balance between research and developmentContribute to designing and implementing generative AI solutions using AWS Bedrock foundation...

  • Gen AI Engineer

    2 weeks ago

    Hyderabad, Telangana, India Accusaga Information Technologies Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Location: HyderabadExperience Required: 2 Positions: 7+ Years & 3 Positions: 4-6 YearsJob Overview:We are looking for experienced and passionate Gen AI Engineers to join our growing team. The ideal candidate will have strong experience in Python, Fast API, and AWS, with hands-on exposure to Generative AI technologies. Experience with Java is a plus.You will...

  • AI/ML Lead with GEN AI

    2 weeks ago

    Hyderabad, Telangana, India ParadigmIT Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:AI/ML Lead with Gen AI expertiseParadigmIT is seeking a hands-on AI/ML Lead with extensive Generative AI expertise to architect, develop, and deliver next-generation AI solutions. The ideal candidate excels at technical leadership and builds production-ready Gen AI systems that create tangible business impact.Key Responsibilities:Architect...

  • Gen AI

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    TCS hiringRole: Gen AILocation: HyderabadExperience: 8-10Must Have:Databricks, Data Science, AI/ML, Gen AI, Prompt Engg, LangChain, MLOps,:Python, Azure OpenAI, Azure Machine Learning, Apache Spark, and SQLFlexible to work as per client's schedule

  • Sr Gen AI Engineer

    4 days ago

    Hyderabad, Telangana, India Blue Yonder Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    OverviewBlue Yonder is looking for an experienced Sr Gen AI Engineer to contribute to the design, development, and implementation of agentic AI-driven solutions at Blue Yonder.This role is not a research role and requires being hands-on and building agentic AI POCs from the ground up to demonstrate the "art of the possible" and business value.The Sr Gen AI...

  • GEN AI Developer

    5 days ago

    Hyderabad, Telangana, India, Telangana LTIMindtree Full time

    Role: Generative AI DeveloperLocation: PAN IndiaExperience Level 5 to 6 years with at least 2 TO 3 years in AIML and 1 to2 years in Gen AI specific workRole Summary :We are seeking a skilled Generative AI Developer to design build and deploy AI driven solutions using large language models LLMs transformer architectures and generative frameworks The ideal...

  • Sr Gen AI Engineer

    2 weeks ago

    Hyderabad, Telangana, India Blue Yonder Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Overview:Blue Yonder is looking for an experienced Sr Gen AI Engineer to contribute to the design, development, and implementation of agentic AI-driven solutions at Blue Yonder.This role is not a research role and requires being hands-on and building agentic AI POCs from the ground up to demonstrate the "art of the possible" and business value.The Sr Gen AI...

  • Senior Gen AI Engineer

    2 weeks ago

    Hyderabad, Telangana, India Soothsayer Analytics Full time US$ 1,20,000 - US$ 2,00,000 per year

    We seek a Senior Gen AI Engineer with strong ML fundamentals and data engineering expertise to lead scalable AI/LLM solutions. This role focuses on integrating AI models into production, optimizing machine learning workflows, and creating scalable AI-driven systems. You will design, fine-tune, and deploy models (e.g., LLMs, RAG architectures) while ensuring...

  • Gen AI/Agentic AI Engineers

    1 week ago

    Hyderabad, Telangana, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Gen AI/Agentic AI EngineersLocation - Bangalore/HyderabadLevel - Senior AssociateExperience - 3-8 yearsSkills & ExperienceStrong background in Python, ML engineering and API development (FastAPIs)Knowledge of tokenization libraries and GenAI/NLP techniques (RAG, embeddings, transformers).Hands-on with GenAI frameworks (LangChain, LlamaIndex, DSPy) and...