SymbolicShapeMode

Enums ยท AiDotNet.NeuralNetworks

Strategy for how CompiledModelHost keys the compile cache. Dynamic dims let one compiled plan serve multiple concrete shapes โ€” essential for bursty inference traffic where every request has a different batch size.

Fields

Field Summary
SymbolicShapeMode AllDynamic Every dim dynamic.
SymbolicShapeMode BatchAndSeqDynamic Dims 0 (batch) and 1 (seq-len) dynamic.
SymbolicShapeMode BatchDynamic Dim 0 (batch) dynamic; all others static.
SymbolicShapeMode Static Every dim treated as static.
int value__