How to meet it
OWASP AISVS v1.01
Adversarial Robustness · Model Alignment, Safety, and Robustness Testing and Training
Run an alignment test suite on every update
Verify that a version-controlled alignment test suite is run on every model update or release.
OWASP AISVS v1.01, requirement 11.1.2
In plain English
Keep a test suite for safe behaviour in version control and run it on every model update or release.
What good looks like
- The suite lives in version control and changes are reviewed.
- It runs automatically on every model change.
- Results are compared with the previous version.
How teams usually do it
- An evaluation job in the release pipeline with stored results per version.
- Adding a test each time an incident or red-team finding exposes a gap.
Evidence an auditor would accept
- The suite's repository history.
- Results for recent releases.
Common mistakes
- A test suite kept in someone's notebook.
- Running the suite but releasing regardless of the result.
Not sure which requirements apply to your system? Take the assessment.
Requirement text from the OWASP AI Security Verification Standard, licensed under CC BY-SA 4.0. This guidance is shared under the same licence.