MambaOptions
Options & Configuration · AiDotNet.NeuralNetworks.Options
Configuration options for MambaLanguageModel.
Inheritance: ModelOptions → NeuralNetworkOptions → ModelHyperparameterOptions → SequenceModelOptions → MambaOptions
For Beginners
Mamba is a language model that reads text left to right while carrying a compact running summary of everything it has seen, instead of re-reading the whole passage at every step the way a transformer does. That makes it fast on long text. You do not need to set anything here — the defaults come with the model.
How It Works
Values are carried over unchanged from the constructor parameters they replace and are NOT yet the paper’s. Mamba-130M is 768 wide with 24 layers; the values below are the demo-sized ones this model has always shipped. Correcting them is a deliberate behavioural change, made in its own phase of issue #2090 so it is reviewed apart from this mechanical move.
Constructors
| Constructor | Summary |
|---|---|
MambaOptions() |
Initializes a new instance of the MambaOptions class with this model’s shipped defaults. |
MambaOptions(MambaOptions other) |
Initializes an instance by copying every declared and inherited setting. |
Methods
| Method | Summary |
|---|---|
void Validate() |
Throws if a value this model requires has been left unset or is not positive. |