GpuStreamPool
Models & Types · AiDotNet.Tensors.Engines.Gpu
No summary documentation available yet.
Implements: IDisposable
Constructors
| Constructor | Summary |
|---|---|
GpuStreamPool(IAsyncGpuBackend backend, GpuExecutionOptions options) |
Properties
| Property | Summary |
|---|---|
IAsyncGpuBackend Backend { get; } |
|
IGpuStream DefaultComputeStream { get; } |
|
IGpuStream DefaultD2HStream { get; } |
|
IGpuStream DefaultH2DStream { get; } |
|
int TotalStreamsCreated { get; } |
Methods
| Method | Summary |
|---|---|
IGpuStream AcquireStream(GpuStreamType streamType) |
|
IGpuStream GetStreamForOperation(bool isH2DTransfer, bool isD2HTransfer) |
|
int GetMaxStreams(GpuStreamType streamType) |
|
void Dispose() |
|
void ReleaseStream(IGpuStream stream) |
|
void SynchronizeAll() |
|
void WaitAllComplete() |