Memory
8 public types in this namespace, organized by kind.
Models & Types (4)
| Type |
Summary |
InferenceContext<T> |
Provides a scoped context for inference operations with automatic tensor pooling and lifecycle management. |
PoolStatistics |
Provides statistics about the current state of a tensor pool. |
PooledMemoryOwner<T> |
An IMemoryOwner implementation that returns memory to the pool when disposed. |
PooledTensor<T> |
A RAII wrapper that automatically returns a pooled tensor to its pool when disposed. |
Structs (2)
| Type |
Summary |
InferenceScopeHandle<T> |
A disposable handle that restores the previous inference context when disposed. |
ShapeKey |
Value-type shape key for arena dictionary lookups. |
Options & Configuration (1)
| Type |
Summary |
PoolingOptions |
Configuration options for the tensor pool, which manages memory reuse during neural network operations. |
Helpers & Utilities (1)
| Type |
Summary |
InferenceScope<T> |
Provides ambient (thread-local) context support for InferenceContext. |