HybridSchedulePattern

Enums · AiDotNet.NeuralNetworks.Layers.SSM

Defines the scheduling pattern for hybrid SSM/attention architectures.

For Beginners

Hybrid architectures mix SSM blocks (like Mamba) with attention blocks. The schedule pattern determines which layers are SSM and which are attention. Different patterns have been shown to work well for different use cases.

Fields

Field Summary
HybridSchedulePattern Custom User provides an explicit sequence of layer types.
HybridSchedulePattern JambaStyle Jamba-style: every Nth layer is attention, rest are SSM.
HybridSchedulePattern SambaStyle Samba-style: alternating Mamba and sliding window attention blocks.
HybridSchedulePattern ZambaStyle Zamba-style: shared attention layers interleaved with Mamba blocks.
int value__