ai - Principal Engineer - Testing

3 days ago

Bengaluru, Karnataka, India Codvo Full time ₹ 1,20,000 - ₹ 3,00,000 per year

Description :

Job Title : Principal Engineer, Test AI Core Services Development.

Location : Bangalore (WFO).

Time 9 : 30AM 6 : 30PM.

Role Requirement :

We are looking for detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services.

You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities.

This role demands deep technical skill and a passion for delivering robust, secure, and ethical AI services at scale.

Youll be a part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools with a builder mindset rapid prototyping and continuous improvement with agility of a start-up.

Key Responsibilities :

- Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure.

- Design and implement automated test suites for APIs, service components, and AI pipelines.

- Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses.

- Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks.

- Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes.

- Participate in threat modelling and security validation of exposed APIs and AI services.

- Provide feedback early in the lifecycle to reduce defects and improve design.

- Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation.

AI & Cloud Expertise :

- Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.

- Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection.

- Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations.

- Defining Performance Metrics for AI services and testing for the same.

- Awareness of AI safety, bias detection, and explainability techniques.

- Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).

- Strong belief in ethical AI practices, transparency, and end-user trust.

Core Skills and Qualifications :

years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.

- Proficient in designing automated testing frameworks.

- Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments.

- Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10).

- Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions.

- Experience working in Agile teams and collaborating across global R&D locations.

- Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation.

  • Principal Engineer, AI Strategy

    2 weeks ago

    Bengaluru, Karnataka, India NatWest Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Principal Engineer, AI Strategy, VP Join us as a Principal Engineer, AI StrategyThis is a challenging role that will see you design and engineer software with the customer or user experience as the primary objective You'll be playing a major role in the engineering centre of excellence, collaborating to improve the bank's overall software engineering...

  • Principal AI Software Engineer

    7 days ago

    Bengaluru, Karnataka, India GE Vernova Full time US$ 1,04,000 - US$ 1,30,878 per year

    Job Description SummaryWe are seeking a highly accomplished Principal AI Software Engineer who has mastered AI-augmented development and can drive technical excellence across our organization. This senior leadership role requires someone who combines exceptional technical depth with strategic thinking, leading the development of complex AI-native...

  • ai - Principal Engineer/Edge AI Engineer

    5 days ago

    Bengaluru, Karnataka, India Codvo Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : We are seeking a highly experienced Principal Engineer/Edge AI CV Engineer to join our MedTech engineering team. The ideal candidate will bring deep expertise in Cloud, Video technologies, and Edge AI to design and deliver innovative healthcare solutions. This role requires strong technical leadership, hands-on engineering skills, and a...

  • AI Test Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Valuebound Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Ai test engineering with AI testing skills along with functional testing skills asjdhiaiushdiaushdSkills: Ai skills,Testing skills,scripting skills

  • Principal Engineer, AI Engineering

    7 days ago

    Bengaluru, Karnataka, India Okta Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Get to know OktaOkta is The World's Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth.At Okta, we celebrate a variety of...

  • Principal Engineer, AI Engineering

    7 days ago

    Bengaluru, Karnataka, India Okta Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Get to know Okta Okta is The World's Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth. At Okta, we celebrate a variety of...

  • Principal Engineer, Web Applications Test Architect

    7 days ago

    Bengaluru, Karnataka, India Sandisk Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionSandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today's needs and tomorrow's next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we're living in...

  • Principal Engineer, Web Applications Test Architect

    7 days ago

    Bengaluru, Karnataka, India Sandisk Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Description Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today's needs and tomorrow's next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we're living in...

  • AI Test Automation Engineer

    7 days ago

    Bengaluru, Karnataka, India Infosys Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    GenAi Consulting• Bachelor's degree in computer engineering or equivalent • 3-5 years of experience in any of the fields -software development, software testing, Test Automation • Proficiency in Python or experience with other automation frameworks used in testing (e.g., Selenium, Playwright, etc.). • Experience with cloud platforms like AWS, Azure,...

  • AI Senior Test Engineer

    7 days ago

    Bengaluru, Karnataka, India Qualitest Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Date: 7 Oct 2025Company: Qualitest GroupCountry/Region: INWe are seeking an AI Test Lead / Senior Test Engineer for test planning and end-to-end testing of cloud-based, data-driven AI Ops platform. The role requires strong expertise in testing, automation, AI/ML, data validation, and cloud services (AWS preferred). He/she will play a pivotal role in ensuring...