RuntimeConfiguration
Options & Configuration · AiDotNet.Deployment.Runtime
Configuration for the deployment runtime environment.
For Beginners
RuntimeConfiguration provides AI safety functionality. Default values follow the original paper settings.
Constructors
| Constructor | Summary |
|---|---|
RuntimeConfiguration() |
Properties
| Property | Summary |
|---|---|
CacheEvictionPolicy CacheEvictionPolicy { get; set; } |
Gets or sets the cache eviction policy. |
bool AutoWarmUp { get; set; } |
Gets or sets whether to enable automatic model warm-up on registration (default: true). |
bool EnableABTesting { get; set; } |
Gets or sets whether to enable A/B testing support (default: false). |
bool EnableCaching { get; set; } |
Gets or sets whether to enable model caching (default: true). |
bool EnableGpuAcceleration { get; set; } |
Gets or sets whether to enable GPU acceleration for inference (default: true). |
bool EnableHealthChecks { get; set; } |
Gets or sets whether to enable health checks (default: true). |
bool EnablePerformanceMonitoring { get; set; } |
Gets or sets whether to enable performance monitoring (default: true). |
bool EnableTelemetry { get; set; } |
Gets or sets whether to enable telemetry collection (default: true). |
bool EnableVersioning { get; set; } |
Gets or sets whether to enable versioning (default: true). |
double CacheSizeMB { get; set; } |
Gets or sets the cache size in megabytes (default: 100 MB). |
double PerformanceAlertThresholdMs { get; set; } |
Gets or sets the performance alert threshold in milliseconds (default: 1000). |
double TelemetrySamplingRate { get; set; } |
Gets or sets the telemetry sampling rate (0.0 to 1.0, default: 1.0 = 100%). |
int HealthCheckIntervalSeconds { get; set; } |
Gets or sets the health check interval in seconds (default: 300 = 5 minutes). |
int InferenceTimeoutSeconds { get; set; } |
Gets or sets the inference timeout in seconds (default: 30). |
int MaxVersionsPerModel { get; set; } |
Gets or sets the maximum number of versions to keep per model (default: 3). |
int ModelLoadTimeoutSeconds { get; set; } |
Gets or sets the model load timeout in seconds (default: 60). |
int TelemetryBufferSize { get; set; } |
Gets or sets the telemetry buffer size (default: 1000 events). |
int TelemetryFlushIntervalSeconds { get; set; } |
Gets or sets the telemetry flush interval in seconds (default: 60). |
int WarmUpIterations { get; set; } |
Gets or sets the number of warm-up iterations (default: 10). |
Methods
| Method | Summary |
|---|---|
RuntimeConfiguration ForDevelopment() |
Creates a configuration for development/testing. |
RuntimeConfiguration ForEdge() |
Creates a minimal configuration for edge devices. |
RuntimeConfiguration ForProduction() |
Creates a configuration for production deployment. |