Senior Test & Verification Lead AI (LLM/VLM)

About the Role

We are looking for a Senior Test & Verification Lead to own the verification and validation strategy for an innovative AI-powered solution.

This is not a traditional software test management position. The role focuses on ensuring that AI models, software components, clinical workflows, and system requirements are appropriately verified, validated, documented, and released in accordance with internal quality standards and regulatory expectations.

You will act as the central authority on test strategy, verification evidence, defect management, and release readiness across engineering, clinical, quality, and regulatory teams.

Key Responsibilities

Verification Strategy & Planning

Define and maintain the overall verification and validation strategy for the AI platform.

Develop risk-based testing approaches covering AI models, software components, integrations, and clinical workflows.

Ensure test activities support both product quality and regulatory requirements.

Establish verification criteria, acceptance criteria, and release gates.

Test Management

Coordinate and oversee:

Functional testing

System testing

Integration testing

Regression testing

AI model verification

User acceptance testing

Ensure adequate test coverage across requirements and identified risks.

Monitor testing progress and report quality metrics to stakeholders.

Requirements & Traceability

Ensure requirements are traceable through:

Design

Implementation

Verification activities

Release decisions

Maintain clear linkage between requirements, test cases, defects, and evidence.

Identify verification gaps and coordinate remediation.

AI Verification & Performance Validation

Review and challenge AI model performance evidence.

Ensure verification activities adequately assess:

Performance

Robustness

Reliability

Edge cases

Bias and fairness considerations

Coordinate with AI and clinical teams to validate findings and performance claims.

Required Experience

8+ years in LLM engineering, Data Science, ML, VLM, or GenAI.

Experience leading verification activities in regulated or high-assurance environments.

Strong understanding of:

Test strategy development

Risk-based testing

Verification & validation methodologies

Defect management

Traceability management

Experience working across engineering, quality, and business stakeholders.

Ability to operate independently and challenge decisions when quality risks exist.

Who are we?

Amaris Consulting is an independent technology consulting firm providing guidance and solutions to businesses. With more than 1000 clients across the globe, we have been rolling out solutions in major projects for over a decade – this is made possible by an international team of 7,600 people spread across 5 continents and more than 60 countries. Our solutions focus on four different Business Lines: Information System & Digital, Telecom, Life Sciences and Engineering. We’re focused on building and nurturing a top talent community where all our team members can achieve their full potential. Amaris is your steppingstone to cross rivers of change, meet challenges and achieve all your projects with success.

At Amaris, we strive to provide our candidates with the best possible recruitment experience. We like to get to know our candidates, challenge them, and be able to give them proper feedback as quickly as possible. Here's what our recruitment process looks like:

Brief Call: Our process typically begins with a brief virtual/phone conversation to get to know you! The objective? Learn about you, understand your motivations, and make sure we have the right job for you!

Interviews (the average number of interviews is 3 - the number may vary depending on the level of seniority required for the position). During the interviews, you will meet people from our team: your line manager of course, but also other people related to your future role. We will talk in depth about you, your experience, and skills, but also about the position and what will be expected of you. Of course, you will also get to know Amaris: our culture, our roots, our teams, and your career opportunities!

Case study: Depending on the position, we may ask you to take a test. This could be a role play, a technical assessment, a problem-solving scenario, etc.

As you know, every person is different and so is every role in a company. That is why we have to adapt accordingly, and the process may differ slightly at times. However, please know that we always put ourselves in the candidate's shoes to ensure they have the best possible experience.

We look forward to meeting you!