GpuTensorRegistry

Models & Types · AiDotNet.Tensors.Engines.Gpu

No summary documentation available yet.

Implements: IDisposable

Constructors

Constructor Summary
GpuTensorRegistry(IDirectGpuBackend backend, GpuExecutionOptions options)

Properties

Property Summary
bool IsUnderMemoryPressure { get; }
double MemoryUsage { get; }
int TensorCount { get; }
long MaxMemoryBytes { get; }
long TotalAllocatedBytes { get; }

Methods

Method Summary
Dictionary<GpuTensorRole, ValueTuple<int, long>> GetStatistics()
TensorRegistration Register(Tensor<float> tensor)
TensorRegistration RegisterBuffer(IGpuBuffer buffer, GpuTensorRole role)
bool TryRegister(Tensor<float> tensor)
long TryEvict(long bytesNeeded)
void Clear()
void Dispose()
void Touch(int registrationId)
void Unregister(int registrationId)