MarbleNetOptions

Options & Configuration · AiDotNet.Audio.VoiceActivity

Configuration options for the MarbleNet voice activity detection model.

Inheritance: ModelOptions → MarbleNetOptions

For Beginners

MarbleNet is NVIDIA’s efficient voice activity detector. It uses a special type of neural network layer (separable convolutions) that makes it very fast while still being accurate. Think of it as a “speech or not?” classifier that can run in real-time even on a phone or small device.

How It Works

MarbleNet (Jia et al., 2021, NVIDIA NeMo) is a lightweight 1D time-channel separable convolutional model for voice activity detection. It uses depth-wise separable convolutions with sub-word modeling to achieve state-of-the-art accuracy while being fast enough for real-time streaming on edge devices.

Constructors

Constructor Summary
MarbleNetOptions()

Properties

Property Summary
OnnxModelOptions OnnxOptions { get; set; } Gets or sets the ONNX runtime options.
double DropoutRate { get; set; } Gets or sets the dropout rate.
double LearningRate { get; set; } Gets or sets the learning rate.
double Threshold { get; set; } Gets or sets the detection threshold.
int FftSize { get; set; } Gets or sets the FFT window size.
int FrameDurationMs { get; set; } Gets or sets the frame duration in milliseconds.
int HopLength { get; set; } Gets or sets the hop length between frames.
int InitialFilters { get; set; } Gets or sets the number of initial convolution filters.
int KernelSize { get; set; } Gets or sets the kernel size for separable convolutions.
int MinSilenceDurationMs { get; set; } Gets or sets the minimum silence duration in milliseconds.
int MinSpeechDurationMs { get; set; } Gets or sets the minimum speech duration in milliseconds.
int NumBlocks { get; set; } Gets or sets the number of separable conv blocks.
int NumMels { get; set; } Gets or sets the number of mel filterbank channels.
int SampleRate { get; set; } Gets or sets the expected audio sample rate in Hz.
int SubBlocksPerBlock { get; set; } Gets or sets the number of sub-blocks per block.
string ModelPath { get; set; } Gets or sets the path to the ONNX model file.