RuntimeConfiguration

Options & Configuration · AiDotNet.Deployment.Runtime

Configuration for the deployment runtime environment.

For Beginners

RuntimeConfiguration provides AI safety functionality. Default values follow the original paper settings.

Constructors

Constructor Summary
RuntimeConfiguration()

Properties

Property Summary
CacheEvictionPolicy CacheEvictionPolicy { get; set; } Gets or sets the cache eviction policy.
bool AutoWarmUp { get; set; } Gets or sets whether to enable automatic model warm-up on registration (default: true).
bool EnableABTesting { get; set; } Gets or sets whether to enable A/B testing support (default: false).
bool EnableCaching { get; set; } Gets or sets whether to enable model caching (default: true).
bool EnableGpuAcceleration { get; set; } Gets or sets whether to enable GPU acceleration for inference (default: true).
bool EnableHealthChecks { get; set; } Gets or sets whether to enable health checks (default: true).
bool EnablePerformanceMonitoring { get; set; } Gets or sets whether to enable performance monitoring (default: true).
bool EnableTelemetry { get; set; } Gets or sets whether to enable telemetry collection (default: true).
bool EnableVersioning { get; set; } Gets or sets whether to enable versioning (default: true).
double CacheSizeMB { get; set; } Gets or sets the cache size in megabytes (default: 100 MB).
double PerformanceAlertThresholdMs { get; set; } Gets or sets the performance alert threshold in milliseconds (default: 1000).
double TelemetrySamplingRate { get; set; } Gets or sets the telemetry sampling rate (0.0 to 1.0, default: 1.0 = 100%).
int HealthCheckIntervalSeconds { get; set; } Gets or sets the health check interval in seconds (default: 300 = 5 minutes).
int InferenceTimeoutSeconds { get; set; } Gets or sets the inference timeout in seconds (default: 30).
int MaxVersionsPerModel { get; set; } Gets or sets the maximum number of versions to keep per model (default: 3).
int ModelLoadTimeoutSeconds { get; set; } Gets or sets the model load timeout in seconds (default: 60).
int TelemetryBufferSize { get; set; } Gets or sets the telemetry buffer size (default: 1000 events).
int TelemetryFlushIntervalSeconds { get; set; } Gets or sets the telemetry flush interval in seconds (default: 60).
int WarmUpIterations { get; set; } Gets or sets the number of warm-up iterations (default: 10).

Methods

Method Summary
RuntimeConfiguration ForDevelopment() Creates a configuration for development/testing.
RuntimeConfiguration ForEdge() Creates a minimal configuration for edge devices.
RuntimeConfiguration ForProduction() Creates a configuration for production deployment.