Skip to main content

REQUIRED_RESIDENT_BYTES

Constant REQUIRED_RESIDENT_BYTES 

Source
pub const REQUIRED_RESIDENT_BYTES: u64 = u64::MAX; // 18_446_744_073_709_551_615u64
Expand description

The OpenVINO runtime does not publish a finite upper bound for compiled-model residency.

Requiring the maximal charge makes the provider promise truthful: a process cannot retain u64::MAX bytes for one model. Device integrations must set their aggregate program-residency policy accordingly when admitting an OpenVINO program.