KVCachePrecisionMode
Enums · AiDotNet.Configuration
Controls the numeric precision of KV-cache storage.
Fields
| Field | Summary |
|---|---|
KVCachePrecisionMode Auto |
Select an industry-standard default. |
KVCachePrecisionMode Float16 |
Store KV-cache in FP16 (half precision) to reduce memory use. |
KVCachePrecisionMode Float32 |
Store KV-cache in FP32 (single precision) for maximal numerical fidelity. |
int value__ |