KVCacheQuantizationMode
Enums · AiDotNet.Configuration
Controls optional KV-cache quantization for inference.
Fields
| Field | Summary |
|---|---|
KVCacheQuantizationMode Int8 |
Signed int8 quantization with scaling (advanced, opt-in). |
KVCacheQuantizationMode None |
No quantization (default). |
int value__ |