Expand description
Intel OpenVINO host backend for NPU, GPU, and CPU execution.
The production path accepts device-neutral TOSA 1.0 FlatBuffers, validates and analyzes them
with virtio-accel-tosa, and lowers supported static floating-point and exact INT8 graphs to
in-memory OpenVINO IR inside this host-native crate. Models are compiled with the ACCURACY execution
mode hint so plugins may not silently execute a declared-FP32 graph at reduced precision.
Program buffers are page-aligned allocations wrapped directly by OpenVINO tensors created
from host pointers; output execution is accepted only when the runtime uses the same
allocation as its output tensor.
The native modules compile only when the build script detects an OpenVINO C runtime
(libopenvino_c) via pkg-config or the VIRTIO_ACCEL_OPENVINO_LIB_DIR override; the
VIRTIO_ACCEL_OPENVINO variable forces the probe on (1, failing loudly when the runtime is
missing) or off (0). Builds without the runtime keep the portable lowering module and an
unsupported-runtime placeholder.
Structs§
- Open
Vino Accelerator - Placeholder that keeps workspace consumers portable when no OpenVINO runtime was detected.
Enums§
- Init
Error - Failure to initialize an OpenVINO backend instance.
- Lowering
Error
Constants§
- OPENVINO_
TOSA_ CAPABILITY - Conservative floating-profile capability boundary for OpenVINO lowering.
- OPENVINO_
TOSA_ FP8_ CAPABILITY - FP8 capability boundary (ADR 0009):
(FP8, FP8) -> FP16MATMUL and exact FP8 data movement. - OPENVINO_
TOSA_ FP8_ TARGET - TOSA FP8 target (ADR 0009), mirroring
VULKAN_TOSA_FP8_TARGETexactly. - OPENVINO_
TOSA_ INTEGER_ CAPABILITY - Conservative exact integer-profile capability boundary for OpenVINO lowering.
- OPENVINO_
TOSA_ INTEGER_ TARGET - TOSA integer-profile target lowered with exact INT8 storage and INT32 arithmetic.
- OPENVINO_
TOSA_ TARGET - TOSA target currently lowered by the OpenVINO backend.
- REQUIRED_
RESIDENT_ BYTES - The OpenVINO runtime does not publish a finite upper bound for compiled-model residency.
Functions§
- supports_
tosa_ dtype - Whether this lowering can expose
dtypeat an OpenVINO model boundary. - supports_
tosa_ operator - Whether the initial OpenVINO lowering tier can lower
opfor supported types and attributes.