CacheDataType

Enums · AiDotNet.Inference

Data types supported for KV-Cache storage.

Fields

Field Summary
CacheDataType BFloat16 Brain float 16 (used by TPUs).
CacheDataType Float16 Half precision (16-bit float).
CacheDataType Float32 Single precision (32-bit float).
CacheDataType Float64 Double precision (64-bit float).
CacheDataType Int8 Signed 8-bit integer quantization (int8) with scaling.
int value__