Memory

8 public types in this namespace, organized by kind.

Models & Types (4)

Type Summary
InferenceContext<T> Provides a scoped context for inference operations with automatic tensor pooling and lifecycle management.
PoolStatistics Provides statistics about the current state of a tensor pool.
PooledMemoryOwner<T> An IMemoryOwner implementation that returns memory to the pool when disposed.
PooledTensor<T> A RAII wrapper that automatically returns a pooled tensor to its pool when disposed.

Structs (2)

Type Summary
InferenceScopeHandle<T> A disposable handle that restores the previous inference context when disposed.
ShapeKey Value-type shape key for arena dictionary lookups.

Options & Configuration (1)

Type Summary
PoolingOptions Configuration options for the tensor pool, which manages memory reuse during neural network operations.

Helpers & Utilities (1)

Type Summary
InferenceScope<T> Provides ambient (thread-local) context support for InferenceContext.