Functional Test Engineer – Agentic AI Solution

4 days ago

Noida, Uttar Pradesh, India Dailoqa Full time US$ 90,000 - US$ 1,20,000 per year

Job Title: Functional Tester – Agentic AI Solution (Banking & Wealth Management)

Location: Noida

Experience Level: 2–6 years

Reports To: QA Lead / Product Manager

We are looking for an experienced Functional Tester to validate the business workflows, compliance logic, and customer-facing features of an Agentic AI solution built for the banking and wealth management domain. This solution leverages LLMs, retrieval-augmented generation (RAG), and domain ontologies to provide intelligent data retrieval, client interaction, and regulatory compliance automation.


Key Responsibilities

Functional Testing

  • Understand functional and non-functional requirements for Agentic AI features (e.g., document Q&A, investment summarization, client onboarding, compliance tracking)
  • Validate end-to-end user journeys across banking and wealth advisory use cases
  • Test conversational workflows and agentic logic flows (multi-step LLM tasks)
  • Verify outputs from LLMs for relevance, consistency, and context-awareness
  • Ensure correct role-based access across advisors, relationship managers, and compliance officers

Test Planning & Execution

  • Prepare detailed test plans, test cases, and traceability matrices from EPICs, features, and user stories
  • Execute manual testing for user interfaces, APIs, and chat/agent interactions
  • Perform regression testing across AI pipelines after prompt or model updates
  • Log, track, and retest defects using tools like Azure DevOps, Jira, or TestRail
  • AI Model & RAG Testing
  • Validate grounding of LLM responses from vector databases (e.g., Azure AI Search, Pinecone)
  • Check performance of RAG pipelines including hallucination mitigation, context window boundaries, and fallback logic
  • Test interaction of agent orchestration flows (LangChain/Autogen/semantic kernel)
  • Verify prompt-based test cases for accuracy and coverage
  • Integration & Data Testing
  • Validate PDF/statement extraction logic from custodians (e.g., Morgan Stanley, Pershing)
  • Check structured data output (JSON, tables) from Azure Form Recognizer or OpenAI pipelines

Ensure data integrity and lineage from ingestion → processing → user response

Must-Have Skills & Tools Category Tools/Tech Test Management Azure / AWA DevOps, Jira, TestRail, Azure Board Test Types Functional, UI, Integration, AI behavior Domain Knowledge Wealth Mgmt workflows, KYC, portfolio views, regulatory rules AI Concepts LLM output validation, RAG testing, prompt engineering basics Data JSON validation, SQL for test data setup Tools (Optional) Postman, Python (for test automation scripts), Excel-based test mapping

Preferred Qualifications

  • Bachelor's degree in Engineering, Finance, or Computer Science
  • Experience testing AI/ML solutions or conversational AI products
  • Familiarity with Azure AI stack, OpenAI, or AWS Bedrock
  • Exposure to compliance-heavy domains like banking, wealth, or insurance
  • Ability to work with cross-functional Agile teams (product, engineering, AI/ML, compliance)

Nice-to-Have Skills

  • Experience writing prompt-based test cases for LLMs
  • Familiarity with agentic workflows (e.g., task chaining, autonomy testing)
  • Understanding of financial statement formats (portfolio summaries, trade confirms)
  • Basic scripting to validate data output (e.g., Python, bash)

  • Forward Deployed AI Agent Engineer

    5 days ago

    Noida, Uttar Pradesh, India beBeeArtificial Full time ₹ 18,00,000 - ₹ 24,00,000

    AI Agent Engineer OpportunityWe are looking for a skilled AI Agent Engineer to join our team. As an AI Agent Engineer, you will work on delivering high-quality Voice AI Agents for our customers. You will leverage our platform to configure, fine-tune, and architect state-of-the-art AI Agents.The successful candidate will have expertise in building voice AI...

  • Agentic AI Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India IENERGY ® Full time

    Company DescriptionIENERGY NETZERO is a leading EHS and ESG software platform designed to empower organizations with robust digital systems for Environment, Health & Safety, Sustainability, and ESG reporting. Built on decades of domain expertise, the platform leverages advanced technology to integrate real-time data, enabling intuitive workflows and powerful...

  • Agentic AI Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India IENERGY Full time

    Company Description IENERGY NETZERO is a leading EHS and ESG software platform designed to empower organizations with robust digital systems for Environment, Health & Safety, Sustainability, and ESG reporting. Built on decades of domain expertise, the platform leverages advanced technology to integrate real-time data, enabling intuitive workflows and...

  • Agentic AI Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India IENERGY ® Full time

    Company Description IENERGY NETZERO is a leading EHS and ESG software platform designed to empower organizations with robust digital systems for Environment, Health & Safety, Sustainability, and ESG reporting. Built on decades of domain expertise, the platform leverages advanced technology to integrate real-time data, enabling intuitive workflows and...

  • Agentic AI Engineer

    4 days ago

    Noida, Uttar Pradesh, India IENERGY ® Full time US$ 1,20,000 - US$ 2,00,000 per year

    Company DescriptionIENERGY NETZERO is a leading EHS and ESG software platform designed to empower organizations with robust digital systems for Environment, Health & Safety, Sustainability, and ESG reporting. Built on decades of domain expertise, the platform leverages advanced technology to integrate real-time data, enabling intuitive workflows and powerful...

  • AI Agent Product Manager

    4 days ago

    Noida, Uttar Pradesh, India SquadStack Full time US$ 1,50,000 - US$ 2,00,000 per year

    About this roleAs an AI Agent Product Manager at SquadStack, you'll own each stage of the AI Agent building and deployment process for the largest consumer enterprises, including Tata, Axis, Bajaj, IndiaMart, Justdial, PhonePe, Zepto, Kotak, and more.You'll work directly with VP and C-level executives to shape their AI roadmap, write and test prompt logic...

  • AI Agent Engineer

    4 days ago

    Noida, Uttar Pradesh, India Uplers Full time ₹ 5,00,000 - ₹ 10,00,000 per year

    Experience: yearsSalary: INR / year (based on experience)Expected Notice Period: 30 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: Office (Noida)Placement Type: Full Time Permanent position(Payroll and Compliance to be managed by: Threat Modeler Software Inc)**(*Note: This is a requirement for one of Uplers' client - Threat Modeler Software...

  • Expert Agentic AI Solutions Developer

    3 days ago

    Noida, Uttar Pradesh, India beBeeArtificialIntelligence Full time US$ 1,80,000 - US$ 2,20,000

    Job Title: Senior AI ArchitectKey Responsibilities:Design and implement end-to-end agentic AI solutions that align with business objectives.Lead cross-functional teams in the development and deployment of scalable agentic AI applications and infrastructures.Evaluate, recommend, and integrate advanced AI/ML platforms, frameworks, and technologies that enable...

  • AI Agent Platform Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India Crenovent Full time

    Job Title: AI Agent Platform Engineer Location: Noida Department: Product Engineering – RevAi ProRole OverviewYou will be responsible for designing, developing, and scaling the AI Agent Framework that powers automation-first modules in RevAi Pro, such as Tell Me, Action Center, and intelligent AI agents. This role is critical to shaping the core foundation...

  • AI Agent Platform Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India Crenovent Full time

    Job Title: AI Agent Platform Engineer Location: Noida Department: Product Engineering – RevAi Pro Role Overview You will be responsible for designing, developing, and scaling the AI Agent Framework that powers automation-first modules in RevAi Pro, such as Tell Me , Action Center , and intelligent AI agents . This role is critical to shaping the...