ai - Principal Engineer - Software Testing

1 day ago

Bengaluru, Karnataka, India Codvo Full time

Job Title: Principal Engineer, Test AI Core Services Development.

Location: Bangalore (WFO).

Time 9:30AM 6:30PM.

Company Overview :

At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA.

Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day.

We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results.

Role Requirement-

We are looking for detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services.

You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities.

This role demands deep technical skill and a passion for delivering robust, secure, and ethical AI services at scale.

Youll be a part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools with a builder mindset rapid prototyping and continuous improvement with agility of a start-up.

Key Responsibilities:

- Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure.

- Design and implement automated test suites for APIs, service components, and AI pipelines.

- Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses.

- Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks.

- Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes.

- Participate in threat modelling and security validation of exposed APIs and AI services.

- Provide feedback early in the lifecycle to reduce defects and improve design.

- Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation.

AI & Cloud Expertise

- Familiarity with LLM evaluation techniques, output scoring, and validation frameworks.

- Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection.

- Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations.

- Defining Performance Metrics for AI services and testing for the same.

- Awareness of AI safety, bias detection, and explainability techniques.

- Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act).

- Strong belief in ethical AI practices, transparency, and end-user trust.

Core Skills and Qualifications:

- 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies.

- Proficient in designing automated testing frameworks.

- Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments.

- Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10).

- Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions.

- Experience working in Agile teams and collaborating across global R&D locations.

- Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation.

(ref:hirist.tech)

  • Principal Software Engineer

    4 hours ago

    Bengaluru, Karnataka, India NIKE Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    PRINCIPAL SITE RELIABILITY ENGINEERIndia Technology CenterWHO YOU WILL WORK WITHThe Principal Site Reliability Engineer will work alongside a talented team of Site Reliability Engineers focused on delivering reliabile and observable software used by millions of athletes* around the world. You will be a part of the Resilience Engineering organization which...

  • Principal Software Engineer

    6 hours ago

    Bengaluru, Karnataka, India InRhythm Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    As a Principal Software Engineer, you'll contribute directly to embedding AI across workflows, including delivery, product, and strategy. You'll help accelerate client outcomes through our AI Accelerator and play a hands-on role in the evolution of tools like TestPilot AI, which uses natural language and generative intelligence to automate mobile and web...

  • Principal Software Engineer

    7 hours ago

    Bengaluru, Karnataka, India Harness Full time US$ 1,50,000 - US$ 2,50,000 per year

    Harness is a high-growth company that is disrupting the software delivery market. Our mission is to enable the 30 million software developers in the world to deliver code to their users reliably, efficiently, securely and quickly, increasing customers' pace of innovation while improving the developer experience. We offer solutions for every step of the...

  • Software Principal Engineer

    1 day ago

    Bengaluru, Karnataka, India Dell Full time

    Software Principal Engineer - Automation Python ScriptingThe Software Engineering team delivers next-generation application enhancements and new products for a changing world Working at the cutting edge we design and develop software for platforms peripherals applications and diagnostics xe2x80x94 all with the most advanced technologies tools ...

  • Principal/Senior Quality Assurance Engineer

    4 weeks ago

    Bengaluru, Karnataka, India One Click AI Full time

    Job Title : Principal / Senior QA EngineerLocation : Hyderabad / Bangalore, IndiaJob Type : the Role :We are seeking a highly skilled Principal/Senior QA Engineer with extensive experience in non-functional, performance, and automation testing for complex, large-scale cloud applications. The ideal candidate will have hands-on expertise in testing query...

  • AI Software Engineer

    5 hours ago

    Bengaluru, Karnataka, India Slidely AI Full time ₹ 4,00,00,000 - ₹ 6,05,00,000 per year

    Slidely is a PowerPoint AI assistant used by consulting companies and fortune 500 teams. A typical professional spends 1 to 3 hours in creating one slide. With Slidely, they create a v1 of their entire deck in 10 minutes, and make changes like "turn this table to a chart" in seconds directly within PowerPoint.In the next 2 years, our goal at Slidely is to...

  • AI-Driven Software Test Engineer

    3 days ago

    Bengaluru, Karnataka, India beBeeArtificialintelligence Full time ₹ 20,00,000 - ₹ 25,00,000

    Software Engineer - AI TestingWe are seeking a highly skilled software engineer with a passion for artificial intelligence and quality engineering practices.Key Responsibilities:Design, develop, and maintain test automation frameworks using various programming languages.Leverage Generative AI tools to automate test script generation from...

  • Principal Software Maintenance Engineer

    6 hours ago

    Bengaluru, Karnataka, India Red Hat Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About the Job  Red Hat is looking for a Principal Software Maintenance Engineer to help a new team aimed at improving the long-term product experience of our Red Hat OpenShift AI(RHOAI) customers. In this role, you will work closely with Product Engineering to deliver extended product maintenance work, including handling bugs and CVEs in extended life...

  • Senior Staff/Principal Engineer

    5 days ago

    Bengaluru, Karnataka, India Eridu AI Full time US$ 1,50,000 - US$ 2,00,000 per year

    Position OverviewDescribe the role and team the candidate will be joiningResponsibilities We are looking for a Principal Engineer to lead the design and development of Software Development Kit (SDK), the critical abstraction layer between the hardware and software ecosystems. You will work across Silicon, System and NOS teams to ensure our high-performance...

  • Principal Engineer

    3 days ago

    Bengaluru, Karnataka, India Codvo Full time

    Job DescriptionJob Title: Principal Engineer, Test AI Core Services DevelopmentLocation: Bangalore (WFO)Time 9:30AM 6:30PMCompany OverviewAt Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness,...