EdgeConfiguration
Options & Configuration · AiDotNet.Deployment.Edge
Configuration for edge device deployment optimization.
For Beginners
EdgeConfiguration provides AI safety functionality. Default values follow the original paper settings.
Constructors
| Constructor | Summary |
|---|---|
EdgeConfiguration() |
Properties
| Property | Summary |
|---|---|
EdgeDeviceType TargetDevice { get; set; } |
Gets or sets the target device type. |
PartitionStrategy PartitionStrategy { get; set; } |
Gets or sets the partition strategy. |
QuantizationMode QuantizationMode { get; set; } |
Gets or sets the quantization mode for edge devices. |
bool EnableAdaptiveInference { get; set; } |
Gets or sets whether to enable adaptive inference (default: false). |
bool EnableArmNeonOptimization { get; set; } |
Gets or sets whether to enable ARM NEON optimization (default: true). |
bool EnableLayerFusion { get; set; } |
Gets or sets whether to enable layer fusion (default: true). |
bool EnableModelPartitioning { get; set; } |
Gets or sets whether to enable model partitioning for cloud+edge (default: false). |
bool OptimizeForPower { get; set; } |
Gets or sets whether to optimize for power consumption (default: true). |
bool UsePruning { get; set; } |
Gets or sets whether to use pruning (default: true). |
bool UseQuantization { get; set; } |
Gets or sets whether to use quantization (default: true). |
double CacheSizeMB { get; set; } |
Gets or sets the cache size for intermediate results in MB (default: 5 MB). |
double MaxMemoryUsageMB { get; set; } |
Gets or sets the maximum memory usage in megabytes (default: 50 MB). |
double MaxModelSizeMB { get; set; } |
Gets or sets the maximum model size in megabytes (default: 10 MB). |
double PruningRatio { get; set; } |
Gets or sets the pruning ratio (0.0 to 1.0, default: 0.3 = 30% sparsity). |
double TargetLatencyMs { get; set; } |
Gets or sets the target inference latency in milliseconds (default: 100 ms). |
Methods
| Method | Summary |
|---|---|
EdgeConfiguration ForCloudEdge() |
Creates a configuration for cloud+edge partitioned deployment. |
EdgeConfiguration ForJetson() |
Creates a configuration for NVIDIA Jetson devices. |
EdgeConfiguration ForMicrocontroller() |
Creates a configuration for microcontrollers (MCU). |
EdgeConfiguration ForRaspberryPi() |
Creates a configuration for Raspberry Pi. |