AI Tester

1 week ago

Mumbai, Maharashtra, India RapidBrains Full time US$ 90,000 - US$ 1,20,000 per year

Job Title :
AI Tester

Experience:
2–3 Years

Location:
Mumbai

Contract Duration:
Long Term

Work Time:
IST Shift

We are seeking a skilled and detail-oriented AI Test Engineer to join our team working on cutting-edge AI agents. In this role, you will be responsible for ensuring the quality, reliability, and performance of AI-driven systems by designing and executing test cases, validating data, and collaborating with developers and data scientists.

Responsibilities:-

Test Planning & Strategy

Develop comprehensive test plans covering functional, regression, performance, and edge-case testing.

Collaborate with developers and data scientists to define acceptance criteria for AI behavior.

Test Case Design & Execution

Design and execute test cases to validate AI agent functionality and accuracy.

Test AI decision-making processes, responses, and interactions.

Data Validation

Verify training data quality and test AI agents' ability to handle diverse inputs.

Identify and report potential issues with data bias or robustness.

Performance & Scalability Testing

Evaluate system performance under load and edge cases.

Identify bottlenecks and optimize AI agent performance.

Bug Reporting & Tracking

Document and track issues using Jira, Trello, or similar tools.

Collaborate with developers for timely resolutions.

Automation & CI/CD

Develop automated test scripts for AI systems.

Integrate automation into CI/CD pipelines for continuous testing.

Collaboration

Work with cross-functional teams (developers, data scientists, product managers).

Participate in agile ceremonies and contribute QA insights.

Technical Skills:-

Strong knowledge of software testing methodologies (functional, regression, performance, usability).

Familiarity with AI/ML concepts: NLP, reinforcement learning, neural networks.

Hands-on experience with test automation tools (Selenium, pytest, etc.).

Proficiency in Python, Java, or JavaScript for scripting.

Knowledge of API testing tools (Postman, REST Assured).

Experience with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions).

AI-Specific Testing Skills:-

Testing AI agent behavior, response accuracy, adaptability.

Data validation and testing models for bias/fairness.

Familiarity with frameworks like TFX, MLflow, or similar.

Soft Skills:-

Strong analytical and problem-solving abilities.

Excellent communication and documentation skills.

High attention to detail and focus on quality delivery.

Nice-to-Have Skills:-

Experience with cloud platforms (AWS, Azure, GCP).

Knowledge of containerization tools (Docker, Kubernetes).

Familiarity with Git, Jira, Confluence.

Qualifications:-

Bachelor's or Master's degree in Computer Science, Engineering, or related field.

2–3 years of software testing experience, including at least 1–2 years testing AI/ML systems.

Certifications in software testing (ISTQB) or AI/ML (TensorFlow Developer, etc.) are a plus.

  • Conversational AI Tester Professional

    7 days ago

    Mumbai, Maharashtra, India beBeeAI Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Role:We are seeking a seasoned Conversational AI Tester to join our team of experts in the Healthcare industry. This is an exciting opportunity for a talented individual to take their testing skills to the next level and contribute to the development of our cutting-edge Conversational AI platform.Responsibilities:Create, execute, and automate complex...

  • AI-Powered Money Coach Beta Tester

    2 days ago

    Mumbai, Maharashtra, India beBeeBeta Full time ₹ 5,00,000 - ₹ 10,00,000

    Beta Testing OpportunityAre you eager to contribute to the development of a cutting-edge AI-powered money coach? We invite you to participate in our Beta Fellowship program, where you will have the chance to test our innovative app and provide valuable feedback.This is a unique opportunity to be part of a pioneering fintech company and gain hands-on...

  • Manual Tester Intern

    1 week ago

    Mumbai, Maharashtra, India Arcitech Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    At , we're redefining the future with AI-powered software solutions across education, recruitment, marketplaces, and more. We're looking for a passionateManual Tester Internwho's ready to work on cutting-edge, scalable, cloud-native platforms and help build the next generation of AI-driven products.Role-Manual Tester InternLocation:Mumbai (In-Office)Company:...

  • Manual Tester

    1 week ago

    Navi Mumbai, Maharashtra, India Arcitech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    At , we're redefining the future with AI-powered software solutions across education, recruitment, marketplaces, and more. We're looking for a passionate Manual Tester who's ready to work on cutting-edge, scalable, cloud-native platforms and help build the next generation of AI-driven products.Role-Manual TesterLocation:Mumbai (In-Office)Company:...

  • Manual Tester Intern

    1 week ago

    Mumbai, Maharashtra, India Arcot Group Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    At , we're redefining the future with AI-powered software solutions across education, recruitment, marketplaces, and more. We're looking for a passionateManual Tester Internwho's ready to work on cutting-edge, scalable, cloud-native platforms and help build the next generation of AI-driven products.Role-Manual Tester InternLocation:Mumbai (In-Office)Company:...

  • Software Tester

    5 days ago

    Navi Mumbai, Maharashtra, India ARCITECH Full time ₹ 40,000 - ₹ 8,50,000 per year

    Arcitech Navi Mumbai, Maharashtra, IndiaOn-siteFull-time2-5 Years experience required₹4 - 85L Per YearPosted TodayAbout CompanyArcitech AI, located in Mumbai's bustling Lower Parel, is a trailblazer in software and IT, specializing in software development, AI, mobile apps, and integrative solutions. Committed to excellence and innovation, Arcitech AI...

  • Software Tester

    3 days ago

    Navi Mumbai, Maharashtra, India Arcitech Full time ₹ 4,00,000 - ₹ 8,50,000 per year

    Position:Software Tester – Automation (On-Site)Experience in Python with SeleniumLocation:Navi MumbaiBudget - 4lpa - 8.5lpaImmediate Joiners PreferredWhy Join Us? Growth-driven environment with exciting projects Weekends off + provident fund benefits Supportive, collaborative & innovation-first cultureRole OverviewAs a Software Tester, you'll play a key...

  • Manual Tester Internship

    3 days ago

    Navi Mumbai, Maharashtra, India Arcot Group Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    At , we're redefining the future with AI-powered software solutions across education, recruitment, marketplaces, and more. We're looking for a passionate Manual Tester Intern who's ready to work on cutting-edge, scalable, cloud-native platforms and help build the next generation of AI-driven products.Role:Manual Tester InternLocation:Mumbai...

  • Junior Manual Tester

    1 week ago

    Navi Mumbai, Maharashtra, India Arcitech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    At , we're redefining the future with AI-powered software solutions across education, recruitment, marketplaces, and more. We're looking for a passionateJunior Manual Testerwho's ready to work on cutting-edge, scalable, cloud-native platforms and help build the next generation of AI-driven products.Role-Junior Manual TesterLocation: Navi Mumbai...

  • Automation Tester

    1 week ago

    Navi Mumbai, Maharashtra, India Arcitech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role Overview:We are looking for a detail-oriented and proactive Automation Tester to join our QA team. The ideal candidate will be responsible for end-to-end testing—including manual, automation, and performance testing—while actively participating in requirement analysis, client discussions, and test strategy implementation. Experience with Selenium,...