AdaptiveInferenceConfig

Options & Configuration · AiDotNet.Deployment.Edge

Configuration for adaptive inference.

For Beginners

AdaptiveInferenceConfig provides AI safety functionality. Default values follow the original paper settings.

Constructors

Constructor Summary
AdaptiveInferenceConfig()

Properties

Property Summary
List<string> SkipLayers { get; set; } Gets or sets the layers to skip for speed.
QualityLevel QualityLevel { get; set; } Gets or sets the quality level.
bool UseQuantization { get; set; } Gets or sets whether to use quantization.
int QuantizationBits { get; set; } Gets or sets the quantization bit width.