AI Testing Engineer

2 days ago

Noida, Uttar Pradesh, India Dailoqa Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title: Functional Tester – (Banking & Wealth Management)

Location
: Noida

Experience Level
: 4–6 years

Reports To
: QA Lead / Product Manager

We are looking for an experienced 
Functional Tester
 to validate the business workflows, compliance logic, and customer-facing features of an 
Agentic AI solution
 built for the 
banking and wealth management domain
. This solution leverages 
LLMs, retrieval-augmented generation (RAG)
, and 
domain ontologies
 to provide intelligent data retrieval, client interaction, and regulatory compliance automation.

Key Responsibilities

Functional Testing

  • Understand 
    functional and non-functional requirements
     for Agentic AI features (e.g., document Q&A, investment summarization, client onboarding, compliance tracking)
  • Validate 
    end-to-end user journeys
     across banking and wealth advisory use cases
  • Test conversational workflows and 
    agentic logic flows
     (multi-step LLM tasks)
  • Verify outputs from LLMs for 
    relevance, consistency, and context-awareness
  • Ensure correct 
    role-based access
     across advisors, relationship managers, and compliance officers

Test Planning & Execution

  • Prepare 
    detailed test plans, test cases
    , and 
    traceability matrices
     from EPICs, features, and user stories
  • Execute 
    manual testing
     for user interfaces, APIs, and chat/agent interactions
  • Perform 
    regression testing
     across AI pipelines after prompt or model updates
  • Log, track, and retest defects using tools like 
    Azure DevOps
    , 
    Jira
    , or 
    TestRail

AI Model & RAG Testing

  • Validate grounding of LLM responses from 
    vector databases (e.g., Azure AI Search, Pinecone)
  • Check performance of 
    RAG pipelines
     including hallucination mitigation, context window boundaries, and fallback logic
  • Test interaction of 
    agent orchestration flows
     (LangChain/Autogen/semantic kernel)
  • Verify prompt-based test cases for accuracy and coverage

Integration & Data Testing

  • Validate 
    PDF/statement extraction logic
     from custodians (e.g., Morgan Stanley, Pershing)
  • Check structured data output (JSON, tables) from Azure Form Recognizer or OpenAI pipelines
  • Ensure 
    data integrity and lineage
     from ingestion → processing → user response

Must-Have Skills & Tools

Category

Tools/Tech

Test Management

Azure / AWA DevOps, Jira, TestRail, Azure Board

Test Types

Functional, UI, Integration, AI behavior

Domain Knowledge

Wealth Mgmt workflows, KYC, portfolio views, regulatory rules

AI Concepts

LLM output validation, RAG testing, prompt engineering basics

Data

JSON validation, SQL for test data setup

Tools (Optional)

Postman, Python (for test automation scripts), Excel-based test mapping

Preferred Qualifications

  • Bachelor's degree in Engineering, Finance, or Computer Science
  • Experience testing AI/ML solutions or conversational AI products
  • Familiarity with 
    Azure AI stack
    , OpenAI, or AWS Bedrock
  • Exposure to 
    compliance-heavy domains
     like banking, wealth, or insurance
  • Ability to work with cross-functional Agile teams (product, engineering, AI/ML, compliance)

Nice-to-Have Skills

  • Experience writing 
    prompt-based test cases
     for LLMs

  • AI Mobile Test Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Transsion Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position: AI Mobile Test Engineer (Hindi, Tamil, Telugu, Gujarat, Marathi, Bengali)Location: India (On-Site) Noida.Responsibilities:Multilingual Adaptation Testing:Conduct in-depth localization validation forHindi, Tamil, Telugu, Gujarat, Marathi, Bengalilanguages.Identify cultural adaptation issues in UI text, voice interactions, and contextual...

  • AI developer intern

    2 days ago

    Noida, Uttar Pradesh, India Ropeli AI Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionRopeli AIis an intelligent solutions platform powered by prompts, but what makes us unique is our ability to 'untie the ropes' around problems just like a tied rope that restricts, we unravel complex challenges and deliver precise, actionable solutions.Role DescriptionThis is an AI Developer Intern, will be responsible for tasks such as...

  • Python AI Engineer Automated Test Data Generation

    2 weeks ago

    Noida, Uttar Pradesh, India FCS Software Solutions Full time ₹ 7,00,000 - ₹ 12,00,000 per year

    **Urgent Hiring for the Role of Python AI Engineer Automated Test Data Generation for our team**Title: Python AI Engineer Automated Test Data GenerationExperience: 8+yearsLocation : RemoteTiming: US EST HoursOverviewWe are seeking a Python AI Engineer with expertise in synthetic and automated test data generation to support clinical trials, regulatory...

  • Senior Test Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time

    Job DescriptionSenior QA engineerSenior QA engineerExp-6 years Good skill in manual and Automated testing (Selenium)Must have-- Selenium- Java- Scripting- Junit- Postman- Jmeter- PL/SQL- MS SQLGood to have-Monitoring logs & server metrics, AWS, Appium,AI-Based Testing, Scripting & Automation, ISTQB, DevOps & CI/ CD

  • Lead Software Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India Level AI Full time

    Level AI was founded in 2019 and is a Series C startup headquartered in Mountain View, California. Level AI revolutionizes customer engagement by transforming contact centers into strategic assets. Our AI-native platform leverages advanced technologies such as Large Language Models to extract deep insights from customer interactions. By providing actionable...

  • Software Development Engineer in Test

    4 days ago

    Noida, Uttar Pradesh, India S&P Global Market Intelligence Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role:Grade Level (for internal use):09IntroductionS&P Global is seeking experienced Test Engineer who is passionate about delivering high-value, high-impact solutions to the worlds most demanding, high-profile clients. This position is a hands-on test build /execution role. It is a highly technical position and will require strong knowledge of...

  • Software Test Automation Engineer II

    2 weeks ago

    Noida, Uttar Pradesh, India Trintech Full time ₹ 1,04,000 - ₹ 13,08,780 per year

    Skill required:Bachelors degree in Engineering, Computer Science, or related technical field3+ years of experience in QA automation and manual testing for API and web-based applicationsHands-on experience with:Pytest, Playwright, Selenium, or similar automation toolsAPI testing using Postman, HTTPX, or equivalentProficient in scripting with Python or...

  • AI Engineer

    2 days ago

    Noida, Uttar Pradesh, India Version 1 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description Version 1 has celebrated over 28 years in Technology Services and continues to be trusted by global brands to deliver solutions that drive customer success. Version 1 has several strategic technology partners including Microsoft, AWS, Oracle, Red Hat, OutSystems and Snowflake. We're also an award-winning employer reflecting how employees...

  • Staff Software Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India Level AI Full time

    Job Description :Level AI was founded in 2019 and is a Series C startup headquartered in Mountain View, California. Level AI revolutionises customer engagement by transforming contact centres into strategic assets. Our AI-native platform leverages advanced technologies such as Large Language Models to extract deep insights from customer interactions. By...

  • Software Test Automation Engineer II

    3 weeks ago

    Noida, Uttar Pradesh, India Trintech Full time

    Job DescriptionLocation: NoidaWork mode: HybridTHE ROLEWe are looking for a Software Test Automation Engineer II to help build test coverage and ensure quality for intelligent, AI-enhanced features within our enterprise applications. In this role, you will develop and execute automation tests for frontend workflows, backend APIs, and services powered by...