BlockManagerStats

Models & Types · AiDotNet.Inference.PagedAttention

Statistics about the block manager state.

Constructors

Constructor Summary
BlockManagerStats()

Properties

Property Summary
double MemoryUtilization { get; set; } Memory utilization (0-1).
int AllocatedBlocks { get; set; } Number of currently allocated blocks.
int BlockSizeTokens { get; set; } Number of tokens per block.
int FreeBlocks { get; set; } Number of free blocks.
int TotalBlocks { get; set; } Total number of blocks in the pool.
long BytesPerBlock { get; set; } Bytes per block.
long CopyOnWriteCount { get; set; } Number of copy-on-write operations.
long FreeMemoryBytes { get; } Free memory in bytes.
long TotalAllocations { get; set; } Total number of allocations performed.
long TotalFrees { get; set; } Total number of frees performed.
long TotalMemoryBytes { get; set; } Total memory in bytes.
long UsedMemoryBytes { get; } Used memory in bytes.