HuBERTASROptions

Options & Configuration · AiDotNet.SpeechRecognition.Foundation

Options for HuBERT fine-tuned for speech recognition with CTC.

Inheritance: ModelOptions → HuBERTASROptions

For Beginners

These options configure the HuBERT recognizer. The model listens to the raw audio waveform (not a spectrogram) and outputs one character distribution per 20 ms frame.

How It Works

HuBERT (Hsu et al. 2021) pre-trains the wav2vec 2.0 network by masked prediction of clustered hidden units and fine-tunes it with a CTC head over raw 16 kHz audio. The defaults are the BASE model (facebook/hubert-base-ls960 configuration): group norm on the first feature-encoder layer and a post-norm Transformer; set StableLayerNorm with the LARGE sizes (1024 wide, 24 layers, 16 heads, 4096 feed-forward) for HuBERT LARGE.

Constructors

Constructor Summary
HuBERTASROptions() Initializes a new instance with default values.
HuBERTASROptions(HuBERTASROptions other) Initializes a new instance by copying from another instance.

Properties

Property Summary
OnnxModelOptions OnnxOptions { get; set; } ONNX runtime options for the ONNX constructor.
bool FreezeFeatureEncoder { get; set; } Whether fine-tuning keeps the convolutional feature encoder frozen.
bool StableLayerNorm { get; set; } Whether to build the LARGE form: a layer-norm feature encoder with conv bias and a stable (pre-norm) Transformer.
double ActivationDropout { get; set; } Dropout inside each feed-forward block.
double DropoutRate { get; set; } Dropout on the Transformer’s hidden states and attention weights.
double FeatureProjectionDropout { get; set; } Dropout after the feature projection.
double FinalDropout { get; set; } Dropout before the CTC head.
double LayerDrop { get; set; } Probability of skipping each Transformer layer during training.
double MaskTimeProbability { get; set; } SpecAugment time-mask probability during training.
int EncoderDim { get; set; } Transformer width (hidden size).
int FeedForwardDim { get; set; } Feed-forward width of each Transformer layer.
int MaxAudioLengthSeconds { get; set; } Longest audio, in seconds, a transcription reads; longer input is truncated.
int MaxTextLength { get; set; } Most tokens a transcription emits.
int NumAttentionHeads { get; set; } Attention heads per layer.
int NumEncoderLayers { get; set; } Number of Transformer layers.
int PositionalConvGroups { get; set; } Groups of the convolutional positional embedding.
int SampleRate { get; set; } Audio sample rate in Hz.
int VocabSize { get; set; } CTC vocabulary size, blank (token 0) included; tokens above 0 decode as Unicode code points.
string Language { get; set; } Language reported for a transcription when none is given.
string ModelPath { get; set; } Path of an exported ONNX model, for the ONNX constructor.