GpuStreamPool

Models & Types · AiDotNet.Tensors.Engines.Gpu

No summary documentation available yet.

Implements: IDisposable

Constructors

Constructor Summary
GpuStreamPool(IAsyncGpuBackend backend, GpuExecutionOptions options)

Properties

Property Summary
IAsyncGpuBackend Backend { get; }
IGpuStream DefaultComputeStream { get; }
IGpuStream DefaultD2HStream { get; }
IGpuStream DefaultH2DStream { get; }
int TotalStreamsCreated { get; }

Methods

Method Summary
IGpuStream AcquireStream(GpuStreamType streamType)
IGpuStream GetStreamForOperation(bool isH2DTransfer, bool isD2HTransfer)
int GetMaxStreams(GpuStreamType streamType)
void Dispose()
void ReleaseStream(IGpuStream stream)
void SynchronizeAll()
void WaitAllComplete()