How to meet it
OWASP AISVS v1.01
Infrastructure, Configuration & Deployment Security · AI Hardware Security
Wipe GPU memory between workloads
Verify that accelerator (GPU) memory is isolated between workloads through partitioning mechanisms with memory sanitization between jobs.
OWASP AISVS v1.01, requirement 4.2.4
In plain English
Keep GPU memory separate between workloads and wipe it between jobs, so one customer or job cannot read another's leftover data.
What good looks like
- GPUs are partitioned between workloads where they are shared.
- Memory is cleared between jobs.
- Tests confirm leftover data cannot be read.
How teams usually do it
- Hardware partitioning such as multi-instance GPU features, plus memory clearing in the scheduler.
Evidence an auditor would accept
- Partitioning configuration and test results.
Common mistakes
- Time-sharing GPUs between tenants with no memory clearing.
Not sure which requirements apply to your system? Take the assessment.
Requirement text from the OWASP AI Security Verification Standard, licensed under CC BY-SA 4.0. This guidance is shared under the same licence.