SymbolicShapeMode
Enums ยท AiDotNet.NeuralNetworks
Strategy for how CompiledModelHost keys the compile cache. Dynamic
dims let one compiled plan serve multiple concrete shapes โ essential for bursty
inference traffic where every request has a different batch size.
Fields
| Field | Summary |
|---|---|
SymbolicShapeMode AllDynamic |
Every dim dynamic. |
SymbolicShapeMode BatchAndSeqDynamic |
Dims 0 (batch) and 1 (seq-len) dynamic. |
SymbolicShapeMode BatchDynamic |
Dim 0 (batch) dynamic; all others static. |
SymbolicShapeMode Static |
Every dim treated as static. |
int value__ |