HuBERTASROptions
Options & Configuration · AiDotNet.SpeechRecognition.Foundation
Options for HuBERT fine-tuned for speech recognition with CTC.
Inheritance: ModelOptions → HuBERTASROptions
For Beginners
These options configure the HuBERT recognizer. The model listens to the raw audio waveform (not a spectrogram) and outputs one character distribution per 20 ms frame.
How It Works
HuBERT (Hsu et al. 2021) pre-trains the wav2vec 2.0 network by masked prediction of clustered hidden units and fine-tunes it with a CTC head over raw 16 kHz audio. The defaults are the BASE model (facebook/hubert-base-ls960 configuration): group norm on the first feature-encoder layer and a post-norm Transformer; set StableLayerNorm with the LARGE sizes (1024 wide, 24 layers, 16 heads, 4096 feed-forward) for HuBERT LARGE.
Constructors
| Constructor | Summary |
|---|---|
HuBERTASROptions() |
Initializes a new instance with default values. |
HuBERTASROptions(HuBERTASROptions other) |
Initializes a new instance by copying from another instance. |
Properties
| Property | Summary |
|---|---|
OnnxModelOptions OnnxOptions { get; set; } |
ONNX runtime options for the ONNX constructor. |
bool FreezeFeatureEncoder { get; set; } |
Whether fine-tuning keeps the convolutional feature encoder frozen. |
bool StableLayerNorm { get; set; } |
Whether to build the LARGE form: a layer-norm feature encoder with conv bias and a stable (pre-norm) Transformer. |
double ActivationDropout { get; set; } |
Dropout inside each feed-forward block. |
double DropoutRate { get; set; } |
Dropout on the Transformer’s hidden states and attention weights. |
double FeatureProjectionDropout { get; set; } |
Dropout after the feature projection. |
double FinalDropout { get; set; } |
Dropout before the CTC head. |
double LayerDrop { get; set; } |
Probability of skipping each Transformer layer during training. |
double MaskTimeProbability { get; set; } |
SpecAugment time-mask probability during training. |
int EncoderDim { get; set; } |
Transformer width (hidden size). |
int FeedForwardDim { get; set; } |
Feed-forward width of each Transformer layer. |
int MaxAudioLengthSeconds { get; set; } |
Longest audio, in seconds, a transcription reads; longer input is truncated. |
int MaxTextLength { get; set; } |
Most tokens a transcription emits. |
int NumAttentionHeads { get; set; } |
Attention heads per layer. |
int NumEncoderLayers { get; set; } |
Number of Transformer layers. |
int PositionalConvGroups { get; set; } |
Groups of the convolutional positional embedding. |
int SampleRate { get; set; } |
Audio sample rate in Hz. |
int VocabSize { get; set; } |
CTC vocabulary size, blank (token 0) included; tokens above 0 decode as Unicode code points. |
string Language { get; set; } |
Language reported for a transcription when none is given. |
string ModelPath { get; set; } |
Path of an exported ONNX model, for the ONNX constructor. |