HuBERTSEROptions
Options & Configuration ยท AiDotNet.Audio.Emotion
Configuration options for the HuBERT-based Speech Emotion Recognition model.
Inheritance: ModelOptions โ HuBERTSEROptions
For Beginners
HuBERT-SER uses a pre-trained speech understanding model (HuBERT) and teaches it to recognize emotions. HuBERT first learns general speech patterns from millions of hours of audio, then is specialized for emotion detection.
How It Works
HuBERT-SER fine-tunes the HuBERT (Hsu et al., 2021) self-supervised model for speech emotion recognition. HuBERT learns speech representations through masked prediction, and when fine-tuned for SER, achieves strong results on IEMOCAP (69.7% weighted accuracy).
Constructors
| Constructor | Summary |
|---|---|
HuBERTSEROptions() |
Properties
| Property | Summary |
|---|---|
OnnxModelOptions OnnxOptions { get; set; } |
Gets or sets the ONNX runtime options. |
bool IncludeArousalValence { get; set; } |
Gets or sets whether to include arousal/valence regression heads. |
double DropoutRate { get; set; } |
Gets or sets the dropout rate. |
double LearningRate { get; set; } |
Gets or sets the learning rate for training. |
double WeightDecay { get; set; } |
Gets or sets the weight decay for regularization. |
int ClassifierHiddenDim { get; set; } |
Gets or sets the classification head hidden dimension. |
int FeedForwardDim { get; set; } |
Gets or sets the feed-forward dimension. |
int FftSize { get; set; } |
Gets or sets the FFT window size in samples. |
int HopLength { get; set; } |
Gets or sets the hop length between frames in samples. |
int NumAttentionHeads { get; set; } |
Gets or sets the number of attention heads. |
int NumClasses { get; set; } |
Gets or sets the number of emotion classes. |
int NumMels { get; set; } |
Gets or sets the number of mel filterbank channels. |
int NumTransformerLayers { get; set; } |
Gets or sets the number of Transformer layers. |
int SampleRate { get; set; } |
Gets or sets the expected audio sample rate in Hz. |
int TransformerDim { get; set; } |
Gets or sets the Transformer encoder dimension. |
string ModelPath { get; set; } |
Gets or sets the path to the ONNX model file. |
string Variant { get; set; } |
Gets or sets the model variant (base or large). |
string[] EmotionLabels { get; set; } |
Gets or sets the emotion labels. |