ISceneClassifier<T>
Interfaces · AiDotNet.Interfaces
Interface for acoustic scene classification models that identify the environment/context of audio.
Implements: IFeatureAware, IFullModel<T, Tensor<T>, Tensor<T>>, IGradientComputable<T, Tensor<T>, Tensor<T>>
Known implementations: SceneClassifier<T>
For Beginners
Scene classification is like asking “Where was this recording made?”
How it works:
- Audio features capture the overall acoustic character
- A classifier matches these features to known scene types
- The most likely scene (and alternatives) are returned
Example scenes:
- Indoor: Office, restaurant, kitchen, library, shopping mall
- Outdoor: Park, street, beach, forest, construction site
- Transportation: Car, bus, train, metro, airport
How scenes differ from events:
- Event: “A dog barked” (specific sound)
- Scene: “This was recorded in a park” (overall environment)
Use cases:
- Context-aware devices (adjust phone behavior based on location)
- Audio organization (group recordings by location)
- Surveillance (detect unusual environments)
- AR/VR (match virtual audio to real environment)
- Assistive technology (describe environment to blind users)
How It Works
Acoustic scene classification (ASC) identifies the environment or context where audio was recorded. Unlike event detection which finds specific sounds, scene classification characterizes the overall acoustic atmosphere.
This interface extends IFullModel for Tensor-based audio processing.
Properties
| Property | Summary |
|---|---|
IReadOnlyList<string> SupportedScenes { get; } |
Gets the list of scenes this model can classify. |
bool IsOnnxMode { get; } |
Gets whether this model is running in ONNX inference mode. |
double MinimumDurationSeconds { get; } |
Gets the minimum audio duration required for reliable classification. |
int SampleRate { get; } |
Gets the expected sample rate for input audio. |
Methods
| Method | Summary |
|---|---|
IReadOnlyDictionary<string, T> GetSceneProbabilities(Tensor<T> audio) |
Gets scene probabilities for all supported scenes. |
IReadOnlyList<ScenePrediction<T>> GetTopScenes(Tensor<T> audio, int k) |
Gets top-K scene predictions. |
SceneClassificationResult<T> Classify(Tensor<T> audio) |
Classifies the acoustic scene of audio. |
SceneTrackingResult<T> TrackSceneChanges(Tensor<T> audio, double segmentDuration) |
Tracks scene changes over time in longer audio. |
Task<SceneClassificationResult<T>> ClassifyAsync(Tensor<T> audio, CancellationToken cancellationToken) |
Classifies acoustic scene asynchronously. |
Tensor<T> ExtractAcousticFeatures(Tensor<T> audio) |
Extracts acoustic features used for scene classification. |