HybridSchedulePattern
Enums · AiDotNet.NeuralNetworks.Layers.SSM
Defines the scheduling pattern for hybrid SSM/attention architectures.
For Beginners
Hybrid architectures mix SSM blocks (like Mamba) with attention blocks. The schedule pattern determines which layers are SSM and which are attention. Different patterns have been shown to work well for different use cases.
Fields
| Field | Summary |
|---|---|
HybridSchedulePattern Custom |
User provides an explicit sequence of layer types. |
HybridSchedulePattern JambaStyle |
Jamba-style: every Nth layer is attention, rest are SSM. |
HybridSchedulePattern SambaStyle |
Samba-style: alternating Mamba and sliding window attention blocks. |
HybridSchedulePattern ZambaStyle |
Zamba-style: shared attention layers interleaved with Mamba blocks. |
int value__ |