KVCachePrecisionMode

Enums · AiDotNet.Configuration

Controls the numeric precision of KV-cache storage.

Fields

Field Summary
KVCachePrecisionMode Auto Select an industry-standard default.
KVCachePrecisionMode Float16 Store KV-cache in FP16 (half precision) to reduce memory use.
KVCachePrecisionMode Float32 Store KV-cache in FP32 (single precision) for maximal numerical fidelity.
int value__