CacheDevice
Enums · AiDotNet.Inference
Device placement options for KV-Cache.
Fields
| Field | Summary |
|---|---|
CacheDevice Auto |
Automatically select based on available hardware. |
CacheDevice CPU |
Store cache in CPU memory. |
CacheDevice GPU |
Store cache in GPU memory. |
int value__ |