CanaryOptions

Options & Configuration ยท AiDotNet.Audio.SpeechRecognition

Configuration options for the Canary model.

Inheritance: ModelOptions โ†’ CanaryOptions

For Beginners

Canary is like a multilingual transcription assistant. It can listen to speech in many languages and either transcribe it (write down what was said) or translate it into another language, all with a single model.

How It Works

Canary (NVIDIA, 2024) is a multilingual speech recognition model based on the Fast Conformer encoder with a multi-task decoder. It supports automatic speech recognition (ASR), speech translation (ST), and language identification across many languages, using a single unified architecture with task-specific prompting.

Constructors

Constructor Summary
CanaryOptions()

Properties

Property Summary
OnnxModelOptions OnnxOptions { get; set; } Gets or sets the ONNX runtime options.
double DropoutRate { get; set; } Gets or sets the dropout rate.
double LearningRate { get; set; } Gets or sets the learning rate.
int BeamWidth { get; set; } Gets or sets the beam width for decoding.
int DecoderDim { get; set; } Gets or sets the decoder dimension.
int EncoderDim { get; set; } Gets or sets the encoder dimension.
int MaxOutputTokens { get; set; } Gets or sets the maximum output tokens.
int NumDecoderLayers { get; set; } Gets or sets the number of decoder layers.
int NumEncoderLayers { get; set; } Gets or sets the number of encoder layers.
int NumHeads { get; set; } Gets or sets the number of attention heads.
int SampleRate { get; set; } Gets or sets the audio sample rate in Hz.
int SubsamplingFactor { get; set; } Gets or sets the subsampling factor.
int VocabSize { get; set; } Gets or sets the vocabulary size.
string ModelPath { get; set; } Gets or sets the path to the ONNX model file.
string TargetLanguage { get; set; } Gets or sets the target language for translation.
string Variant { get; set; } Gets or sets the model variant.
string[] SupportedLanguages { get; set; } Gets or sets the supported languages.