Copy of AI QA Test Engineer

7 days ago

Hyderabad, Telangana, India Orion Innovation Naukri Full time ₹ 12,00,000 - ₹ 36,00,000 per year

About the Role

Experienced AI QA Test Engineer to ensure the quality, reliability, and ethical performance of AI-driven systems and applications. This role requires a deep understanding of AI/ML workflows, data validation, model testing techniques, and automation frameworks. The ideal candidate is highly analytical, detail-oriented, and passionate about building trusted AI products.

Participates in QA activities on project assignments and ensures timely delivery on QA commitments in a fast-paced product development environment.

Review of functional requirements and technical design documentation and creation of test plans, test scenarios and test cases. Execution of test plans and certification of application releases

Key Responsibilities:

AI/ML Testing

Validate ML models, data pipelines, and inference APIs for accuracy, fairness, and robustnessEvaluate model behavior across diverse data sets, edge cases, and unexpected inputsMonitor model drift, performance degradation, and bias over timeConduct prompt testing, hallucination detection, and safety validation for LLM-based systemsExperience of testing implementation of AI/ML into applicationManual Testing with automation exposureAPI testing with SOAP UI/ PostmanAgile methodology experienceTest & Defect management with JIRA/ Azure DevOps (ADO)DB Testing Experience  - Good to Have Tools - Deepeval/ Langfuse/ Pytest

Quality Engineering & Automation

Build and maintain automated test suites for AI featuresDevelop test scripts for ML workflows using Python, Playwright, and CI/CD toolsDesign and execute manual and automated tests for functional, performance, and security scenariosIdentify defects, establish test metrics, reporting dashboards, and test traceability

Data Quality & Responsible AI

Validate training and inference data quality, labeling consistency, and data governanceWork with data science and product teams to implement responsible AI testing guidelinesDocument and escalate risks related to bias, privacy, explainability, and compliance

Cross-Functional Collaboration

Partner with Data Scientists, ML Engineers, and Product Managers to define acceptance criteriaParticipate in design reviews, model evaluations, and release readiness checkpointsContribute to QA strategy and Test Plans

Required Qualifications

Bachelor's degree in computer science, Engineering, or related field (or equivalent experience)4+ years of experience in software QA engineering2+ years working with AI/ML or data-centric systemsStrong Python programming skillsProficiency in automation frameworks (e.g., Playwright, WebdriverIO, Selenium)Experience with ML platforms (TensorFlow, PyTorch, Hugging Face, MLflow, etc.)Hands-on experience testing APIs, data pipelines, and distributed systemsExposure to RAG pipelines and agent frameworksFamiliarity with prompt testing and LLM evaluation techniquesExperience with model evaluation metrics (precision, recall, F1, ROC-AUC, BLEU, perplexity, etc.)Knowledge of MLOps, CI/CD, and cloud platforms (AWS, Azure, or GCP)Familiarity with Responsible AI frameworks (NIST AI RMF, ISO/IEC standards, fairness toolkits)Experience testing vector databases and AI search (Pinecone, Elasticsearch, Redis Vector)

Key Skills

AI/ML testing & analysisAutomation & scriptingData validation & pipelinesRisk, ethics, & compliance mindsetStrong problem-solving & debugging skillsExcellent documentation & communication skillsWorking with distributed teams

  • Automation Test Engineer

    2 weeks ago

    Hyderabad, Telangana, India Qapitol Qa Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About Us:We are a forward-thinking tech company that strives to deliver high-quality software solutions to our customers. As we continue to expand our engineering team, we are looking for an experienced API Automation Engineer with a strong background in Rest Assured and Web Automation to join us. If you are passionate about delivering reliable, high-quality...

  • QA Engineer AI/ML

    6 days ago

    Hyderabad, Telangana, India Warner Bros. Discovery Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are thestorytellersbringing our characters to life,...

  • Gen AI Engineering in Test

    1 week ago

    Hyderabad, Telangana, India viraaj hr solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Primary Title: Generative AI Engineer in TestIndustry & Sector: Operating in the Enterprise Artificial Intelligence and Quality Engineering sector, delivering production-grade generative-AI features, LLM-driven services, and automated validation frameworks for enterprise customers. We build robust evaluation and test automation to ensure safe, reliable, and...

  • AI Test Automation Engineer

    2 days ago

    Hyderabad, Telangana, India Teradata Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: AI Test Automation EngineerOur company:At Teradata, we believe that people thrive when empowered with better information. That's why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers' customers—to make...

  • Senior AI Test Automation Engineer

    1 day ago

    Hyderabad, Telangana, India Teradata Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: Senior AI Test Automation EngineerWhat You'll DoWe are looking for a highly experienced and forward-thinking Senior AI Test Automation Engineer to develop intelligent, scalable, and resilient test automation solutions. This role combines deep expertise in software testing with cutting-edge AI/ML technologies to drive innovation in quality...

  • QA Automation Engineer

    3 days ago

    Hyderabad, Telangana, India TWO95 International, Inc Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Title: QA Automation EngineerType: Full TimeLocation: HyderabadSalary: INR: Market PossibleRequirements:Job DescriptionQA automation engineer who having 5+ years exp.3+ years in Java with Selenium2+ years in SDET Experience3+ years in Javascript exp1+ years in RubyMobile testing exp required.Key Skills: QA automationJava with SeleniumJava script and...

  • AI Systems Prompt Engineer

    1 week ago

    Hyderabad, Telangana, India Deep AI OCR Full time

    Company DescriptionDeep AI OCR is an "AI First" company that aims to reimagine document processing in organizations by leveraging advanced AI LLMs. We provide efficient and accurate AI-powered optical character recognition solutions that enhance productivity for businesses of all sizes. Our solutions generate 70% of the code using AI, and our trained Agentic...

  • QA Automation Engineer

    2 weeks ago

    Hyderabad, Telangana, India Genpact Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Principal Consultant- QA Automation EngineerPrincipal Consultant- QA Automation Engineer-ITO Ready to build the future with AI? At Genpact, we don't just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of...

  • AI QA Tester

    2 weeks ago

    Hyderabad, Telangana, India Adv Techminds Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: We are seeking a QA Tester with AI testing expertise and programming skills to validate and enhance AI-driven applications. The ideal candidate should have experience in automated testing, AI model evaluation, and software validation across various platforms. Key Responsibilities: AI Testing & Model Validation: Develop and execute test...

  • Salesforce Automation Test Engineer

    1 week ago

    Hyderabad, Telangana, India OSF Digital Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Join OSF Digital: Pioneers in Digital TransformationAt OSF Digital, we are at the forefront of digital innovation, transforming businesses across the globe with cutting-edge solutions. As a trusted partner in the digital landscape, we empower organizations to achieve their goals through our expertise in Salesforce, commerce, and cloud technologies. Our...