AudioFlamingo2Options

Options & Configuration · AiDotNet.Audio.Multimodal

Configuration options for the Audio Flamingo 2 model.

Inheritance: ModelOptions → AudioFlamingo2Options

For Beginners

Audio Flamingo 2 is like giving a language AI the ability to hear. It can listen to audio recordings and answer questions about them, generate descriptions, or reason about what’s happening in the audio scene.

How It Works

Audio Flamingo 2 (2024) extends the Flamingo architecture for audio understanding with interleaved audio-text inputs. It uses a frozen audio encoder with perceiver-style cross-attention to adapt a pre-trained LLM for audio captioning, QA, and reasoning.

Constructors

Constructor Summary
AudioFlamingo2Options() Initializes Audio Flamingo 2 options with paper-default settings.
AudioFlamingo2Options(AudioFlamingo2Options other) Initializes a new instance by deep-copying all settings.

Properties

Property Summary
OnnxModelOptions OnnxOptions { get; set; } Gets or sets the ONNX runtime options.
double DropoutRate { get; set; } Gets or sets the dropout rate.
double LearningRate { get; set; } Gets or sets the learning rate.
double MaxAudioDurationSeconds { get; set; } Gets or sets the maximum audio duration in seconds.
int AudioEncoderDim { get; set; } Gets or sets the audio encoder dimension.
int LLMHiddenDim { get; set; } Gets or sets the LLM hidden dimension.
int MaxResponseTokens { get; set; } Gets or sets the maximum response tokens.
int NumPerceiverLayers { get; set; } Gets or sets the number of perceiver layers.
int NumPerceiverTokens { get; set; } Gets or sets the number of perceiver latent tokens.
int SampleRate { get; set; } Gets or sets the audio sample rate in Hz.
string ModelPath { get; set; } Gets or sets the path to the ONNX model file.
string Variant { get; set; } Gets or sets the model variant.