AI Testing Engineer

3 days ago

Noida, Uttar Pradesh, India Dailoqa Full time ₹ 8,00,000 - ₹ 24,00,000 per year

Job Title: Functional Tester – (Banking & Wealth Management)

Location
: Noida

Experience Level
: 4–6 years

Reports To
: QA Lead / Product Manager

We are looking for an experienced 
Functional Tester
 to validate the business workflows, compliance logic, and customer-facing features of an 
Agentic AI solution
 built for the 
banking and wealth management domain
. This solution leverages 
LLMs, retrieval-augmented generation (RAG)
, and 
domain ontologies
 to provide intelligent data retrieval, client interaction, and regulatory compliance automation.

Key Responsibilities

Functional Testing

  • Understand 
    functional and non-functional requirements
     for Agentic AI features (e.g., document Q&A, investment summarization, client onboarding, compliance tracking)
  • Validate 
    end-to-end user journeys
     across banking and wealth advisory use cases
  • Test conversational workflows and 
    agentic logic flows
     (multi-step LLM tasks)
  • Verify outputs from LLMs for 
    relevance, consistency, and context-awareness
  • Ensure correct 
    role-based access
     across advisors, relationship managers, and compliance officers

Test Planning & Execution

  • Prepare 
    detailed test plans, test cases
    , and 
    traceability matrices
     from EPICs, features, and user stories
  • Execute 
    manual testing
     for user interfaces, APIs, and chat/agent interactions
  • Perform 
    regression testing
     across AI pipelines after prompt or model updates
  • Log, track, and retest defects using tools like 
    Azure DevOps
    , 
    Jira
    , or 
    TestRail

AI Model & RAG Testing

  • Validate grounding of LLM responses from 
    vector databases (e.g., Azure AI Search, Pinecone)
  • Check performance of 
    RAG pipelines
     including hallucination mitigation, context window boundaries, and fallback logic
  • Test interaction of 
    agent orchestration flows
     (LangChain/Autogen/semantic kernel)
  • Verify prompt-based test cases for accuracy and coverage

Integration & Data Testing

  • Validate 
    PDF/statement extraction logic
     from custodians (e.g., Morgan Stanley, Pershing)
  • Check structured data output (JSON, tables) from Azure Form Recognizer or OpenAI pipelines
  • Ensure 
    data integrity and lineage
     from ingestion → processing → user response

Must-Have Skills & Tools

Category

Tools/Tech

Test Management

Azure / AWA DevOps, Jira, TestRail, Azure Board

Test Types

Functional, UI, Integration, AI behavior

Domain Knowledge

Wealth Mgmt workflows, KYC, portfolio views, regulatory rules

AI Concepts

LLM output validation, RAG testing, prompt engineering basics

Data

JSON validation, SQL for test data setup

Tools (Optional)

Postman, Python (for test automation scripts), Excel-based test mapping

Preferred Qualifications

  • Bachelor's degree in Engineering, Finance, or Computer Science
  • Experience testing AI/ML solutions or conversational AI products
  • Familiarity with 
    Azure AI stack
    , OpenAI, or AWS Bedrock
  • Exposure to 
    compliance-heavy domains
     like banking, wealth, or insurance
  • Ability to work with cross-functional Agile teams (product, engineering, AI/ML, compliance)

Nice-to-Have Skills

  • Experience writing 
    prompt-based test cases
     for LLMs

  • AI Mobile Test Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Transsion Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Position: AI Mobile Test Engineer (Hindi, Tamil, Telugu, Gujarat, Marathi, Bengali)Location: India (On-Site) Noida.Responsibilities:Multilingual Adaptation Testing:Conduct in-depth localization validation forHindi, Tamil, Telugu, Gujarat, Marathi, Bengalilanguages.Identify cultural adaptation issues in UI text, voice interactions, and contextual...

  • AI developer intern

    3 days ago

    Noida, Uttar Pradesh, India Ropeli AI Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionRopeli AIis an intelligent solutions platform powered by prompts, but what makes us unique is our ability to 'untie the ropes' around problems just like a tied rope that restricts, we unravel complex challenges and deliver precise, actionable solutions.Role DescriptionThis is an AI Developer Intern, will be responsible for tasks such as...

  • Python AI Engineer Automated Test Data Generation

    2 weeks ago

    Noida, Uttar Pradesh, India FCS Software Solutions Full time ₹ 7,00,000 - ₹ 12,00,000 per year

    **Urgent Hiring for the Role of Python AI Engineer Automated Test Data Generation for our team**Title: Python AI Engineer Automated Test Data GenerationExperience: 8+yearsLocation : RemoteTiming: US EST HoursOverviewWe are seeking a Python AI Engineer with expertise in synthetic and automated test data generation to support clinical trials, regulatory...

  • AI Engineer

    2 days ago

    Noida, Uttar Pradesh, India FCS Software Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: AI EngineerLocation: remoteTerm: Long termWorking times: US EST hoursRole PurposeEnsure the AI models powering the platform remain accurate, aligned, and continuously improved to meet business and compliance requirements, while leveraging data science methods to drive insights, performance improvements, and informed decision-making.Key...

  • AI Engineer

    2 days ago

    Noida, Uttar Pradesh, India Version 1 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description Version 1 has celebrated over 28 years in Technology Services and continues to be trusted by global brands to deliver solutions that drive customer success. Version 1 has several strategic technology partners including Microsoft, AWS, Oracle, Red Hat, OutSystems and Snowflake. We're also an award-winning employer reflecting how employees...

  • Software Development Engineer in Test

    3 days ago

    Noida, Uttar Pradesh, India S&P Global Market Intelligence Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role:Grade Level (for internal use):09IntroductionS&P Global is seeking experienced Test Engineer who is passionate about delivering high-value, high-impact solutions to the worlds most demanding, high-profile clients. This position is a hands-on test build /execution role. It is a highly technical position and will require strong knowledge of...

  • Software Test Automation Engineer II

    2 weeks ago

    Noida, Uttar Pradesh, India Trintech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Skill required:Bachelors degree in Engineering, Computer Science, or related technical field3+ years of experience in QA automation and manual testing for API and web-based applicationsHands-on experience with:Pytest, Playwright, Selenium, or similar automation toolsAPI testing using Postman, HTTPX, or equivalentProficient in scripting with Python or...

  • Automation Test Engineer

    2 days ago

    Noida, Uttar Pradesh, India Thinksys Software Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are looking for an experienced QA Automation Engineer with 3+ years of experience in software testing and automation. The ideal candidate must have a strong background in test automation frameworks, specifically the Page Object Model using TypeScript or JavaScript along with Playwright or Cypress.Key Responsibilities:• Design, develop, and maintain...

  • Lead Software Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Level AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position OverviewWe are looking for a Lead Software Engineer to help raise the engineering bar for the entire technology stack at Level AI, including applications, platform and infrastructure.They will actively collaborate with team members and the wider Level AI engineering community to develop highly scalable and performant systems.They will be a technical...

  • Lead Software Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Level AI Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview : We are looking for a Lead Software Engineer to help raise the engineering bar for the entire technology stack at Level AI, including applications, platform and infrastructure. They will actively collaborate with team members and the wider Level AI engineering community to develop highly scalable and performant systems. They...