AdaptiveInferenceConfig
Options & Configuration · AiDotNet.Deployment.Edge
Configuration for adaptive inference.
For Beginners
AdaptiveInferenceConfig provides AI safety functionality. Default values follow the original paper settings.
Constructors
| Constructor | Summary |
|---|---|
AdaptiveInferenceConfig() |
Properties
| Property | Summary |
|---|---|
List<string> SkipLayers { get; set; } |
Gets or sets the layers to skip for speed. |
QualityLevel QualityLevel { get; set; } |
Gets or sets the quality level. |
bool UseQuantization { get; set; } |
Gets or sets whether to use quantization. |
int QuantizationBits { get; set; } |
Gets or sets the quantization bit width. |