AudioFlamingo2Options
Options & Configuration · AiDotNet.Audio.Multimodal
Configuration options for the Audio Flamingo 2 model.
Inheritance: ModelOptions → AudioFlamingo2Options
For Beginners
Audio Flamingo 2 is like giving a language AI the ability to hear. It can listen to audio recordings and answer questions about them, generate descriptions, or reason about what’s happening in the audio scene.
How It Works
Audio Flamingo 2 (2024) extends the Flamingo architecture for audio understanding with interleaved audio-text inputs. It uses a frozen audio encoder with perceiver-style cross-attention to adapt a pre-trained LLM for audio captioning, QA, and reasoning.
Constructors
| Constructor | Summary |
|---|---|
AudioFlamingo2Options() |
Initializes Audio Flamingo 2 options with paper-default settings. |
AudioFlamingo2Options(AudioFlamingo2Options other) |
Initializes a new instance by deep-copying all settings. |
Properties
| Property | Summary |
|---|---|
OnnxModelOptions OnnxOptions { get; set; } |
Gets or sets the ONNX runtime options. |
double DropoutRate { get; set; } |
Gets or sets the dropout rate. |
double LearningRate { get; set; } |
Gets or sets the learning rate. |
double MaxAudioDurationSeconds { get; set; } |
Gets or sets the maximum audio duration in seconds. |
int AudioEncoderDim { get; set; } |
Gets or sets the audio encoder dimension. |
int LLMHiddenDim { get; set; } |
Gets or sets the LLM hidden dimension. |
int MaxResponseTokens { get; set; } |
Gets or sets the maximum response tokens. |
int NumPerceiverLayers { get; set; } |
Gets or sets the number of perceiver layers. |
int NumPerceiverTokens { get; set; } |
Gets or sets the number of perceiver latent tokens. |
int SampleRate { get; set; } |
Gets or sets the audio sample rate in Hz. |
string ModelPath { get; set; } |
Gets or sets the path to the ONNX model file. |
string Variant { get; set; } |
Gets or sets the model variant. |