SchedulerStatistics

Models & Types · AiDotNet.Serving.ContinuousBatching

Statistics about the scheduler state.

Constructors

Constructor Summary
SchedulerStatistics()

Properties

Property Summary
double MemoryUtilization { get; set; } Memory utilization (0-1).
double SlotUtilization { get; } Cache slot utilization (0-1).
int MaxCacheSlots { get; set; } Maximum number of cache slots.
int PreemptedSequences { get; set; } Number of preempted sequences.
int RunningSequences { get; set; } Number of sequences currently being processed.
int TotalSequences { get; } Total sequences in system.
int UsedCacheSlots { get; set; } Number of cache slots in use.
int WaitingSequences { get; set; } Number of sequences waiting to be processed.
long MaxMemoryBytes { get; set; } Maximum memory available (bytes).
long UsedMemoryBytes { get; set; } Memory currently in use (bytes).