Skip to main content

Crate virtio_accel_openvino

Crate virtio_accel_openvino 

Source
Expand description

Intel OpenVINO host backend for NPU, GPU, and CPU execution.

The production path accepts device-neutral TOSA 1.0 FlatBuffers, validates and analyzes them with virtio-accel-tosa, and lowers supported static floating-point and exact INT8 graphs to in-memory OpenVINO IR inside this host-native crate. Models are compiled with the ACCURACY execution mode hint so plugins may not silently execute a declared-FP32 graph at reduced precision. Program buffers are page-aligned allocations wrapped directly by OpenVINO tensors created from host pointers; output execution is accepted only when the runtime uses the same allocation as its output tensor.

The native modules compile only when the build script detects an OpenVINO C runtime (libopenvino_c) via pkg-config or the VIRTIO_ACCEL_OPENVINO_LIB_DIR override; the VIRTIO_ACCEL_OPENVINO variable forces the probe on (1, failing loudly when the runtime is missing) or off (0). Builds without the runtime keep the portable lowering module and an unsupported-runtime placeholder.

Structs§

OpenVinoAccelerator
Placeholder that keeps workspace consumers portable when no OpenVINO runtime was detected.

Enums§

InitError
Failure to initialize an OpenVINO backend instance.
LoweringError

Constants§

OPENVINO_TOSA_CAPABILITY
Conservative floating-profile capability boundary for OpenVINO lowering.
OPENVINO_TOSA_FP8_CAPABILITY
FP8 capability boundary (ADR 0009): (FP8, FP8) -> FP16 MATMUL and exact FP8 data movement.
OPENVINO_TOSA_FP8_TARGET
TOSA FP8 target (ADR 0009), mirroring VULKAN_TOSA_FP8_TARGET exactly.
OPENVINO_TOSA_INTEGER_CAPABILITY
Conservative exact integer-profile capability boundary for OpenVINO lowering.
OPENVINO_TOSA_INTEGER_TARGET
TOSA integer-profile target lowered with exact INT8 storage and INT32 arithmetic.
OPENVINO_TOSA_TARGET
TOSA target currently lowered by the OpenVINO backend.
REQUIRED_RESIDENT_BYTES
The OpenVINO runtime does not publish a finite upper bound for compiled-model residency.

Functions§

supports_tosa_dtype
Whether this lowering can expose dtype at an OpenVINO model boundary.
supports_tosa_operator
Whether the initial OpenVINO lowering tier can lower op for supported types and attributes.