CacheDataType
Enums · AiDotNet.Inference
Data types supported for KV-Cache storage.
Fields
| Field | Summary |
|---|---|
CacheDataType BFloat16 |
Brain float 16 (used by TPUs). |
CacheDataType Float16 |
Half precision (16-bit float). |
CacheDataType Float32 |
Single precision (32-bit float). |
CacheDataType Float64 |
Double precision (64-bit float). |
CacheDataType Int8 |
Signed 8-bit integer quantization (int8) with scaling. |
int value__ |