BlockManagerStats
Models & Types · AiDotNet.Inference.PagedAttention
Statistics about the block manager state.
Constructors
| Constructor | Summary |
|---|---|
BlockManagerStats() |
Properties
| Property | Summary |
|---|---|
double MemoryUtilization { get; set; } |
Memory utilization (0-1). |
int AllocatedBlocks { get; set; } |
Number of currently allocated blocks. |
int BlockSizeTokens { get; set; } |
Number of tokens per block. |
int FreeBlocks { get; set; } |
Number of free blocks. |
int TotalBlocks { get; set; } |
Total number of blocks in the pool. |
long BytesPerBlock { get; set; } |
Bytes per block. |
long CopyOnWriteCount { get; set; } |
Number of copy-on-write operations. |
long FreeMemoryBytes { get; } |
Free memory in bytes. |
long TotalAllocations { get; set; } |
Total number of allocations performed. |
long TotalFrees { get; set; } |
Total number of frees performed. |
long TotalMemoryBytes { get; set; } |
Total memory in bytes. |
long UsedMemoryBytes { get; } |
Used memory in bytes. |