MambaOptions

Options & Configuration · AiDotNet.NeuralNetworks.Options

Configuration options for MambaLanguageModel.

Inheritance: ModelOptions → NeuralNetworkOptions → ModelHyperparameterOptions → SequenceModelOptions → MambaOptions

For Beginners

Mamba is a language model that reads text left to right while carrying a compact running summary of everything it has seen, instead of re-reading the whole passage at every step the way a transformer does. That makes it fast on long text. You do not need to set anything here — the defaults come with the model.

How It Works

Values are carried over unchanged from the constructor parameters they replace and are NOT yet the paper’s. Mamba-130M is 768 wide with 24 layers; the values below are the demo-sized ones this model has always shipped. Correcting them is a deliberate behavioural change, made in its own phase of issue #2090 so it is reviewed apart from this mechanical move.

Constructors

Constructor Summary
MambaOptions() Initializes a new instance of the MambaOptions class with this model’s shipped defaults.
MambaOptions(MambaOptions other) Initializes an instance by copying every declared and inherited setting.

Methods

Method Summary
void Validate() Throws if a value this model requires has been left unset or is not positive.