SchedulerStatistics
Models & Types · AiDotNet.Serving.ContinuousBatching
Statistics about the scheduler state.
Constructors
| Constructor | Summary |
|---|---|
SchedulerStatistics() |
Properties
| Property | Summary |
|---|---|
double MemoryUtilization { get; set; } |
Memory utilization (0-1). |
double SlotUtilization { get; } |
Cache slot utilization (0-1). |
int MaxCacheSlots { get; set; } |
Maximum number of cache slots. |
int PreemptedSequences { get; set; } |
Number of preempted sequences. |
int RunningSequences { get; set; } |
Number of sequences currently being processed. |
int TotalSequences { get; } |
Total sequences in system. |
int UsedCacheSlots { get; set; } |
Number of cache slots in use. |
int WaitingSequences { get; set; } |
Number of sequences waiting to be processed. |
long MaxMemoryBytes { get; set; } |
Maximum memory available (bytes). |
long UsedMemoryBytes { get; set; } |
Memory currently in use (bytes). |