GpuTensorRegistry
Models & Types · AiDotNet.Tensors.Engines.Gpu
No summary documentation available yet.
Implements: IDisposable
Constructors
| Constructor | Summary |
|---|---|
GpuTensorRegistry(IDirectGpuBackend backend, GpuExecutionOptions options) |
Properties
| Property | Summary |
|---|---|
bool IsUnderMemoryPressure { get; } |
|
double MemoryUsage { get; } |
|
int TensorCount { get; } |
|
long MaxMemoryBytes { get; } |
|
long TotalAllocatedBytes { get; } |
Methods
| Method | Summary |
|---|---|
Dictionary<GpuTensorRole, ValueTuple<int, long>> GetStatistics() |
|
TensorRegistration Register(Tensor<float> tensor) |
|
TensorRegistration RegisterBuffer(IGpuBuffer buffer, GpuTensorRole role) |
|
bool TryRegister(Tensor<float> tensor) |
|
long TryEvict(long bytesNeeded) |
|
void Clear() |
|
void Dispose() |
|
void Touch(int registrationId) |
|
void Unregister(int registrationId) |