AsyncGpuTransfer

Models & Types · AiDotNet.Tensors.Engines

No summary documentation available yet.

Implements: IDisposable

Constructors

Constructor Summary
AsyncGpuTransfer(int deviceId, int maxConcurrentStreams)

Properties

Property Summary
int MaxConcurrentStreams { get; }
int PendingTransferCount { get; }

Methods

Method Summary
DoubleBuffer<T> CreateDoubleBuffer(int bufferSize)
Task DeviceToDeviceAsync(GpuBuffer<T> source, GpuBuffer<T> destination, int priority)
Task DeviceToHostAsync(GpuBuffer<T> deviceBuffer, Memory<T> hostData, int priority)
Task HostToDeviceAsync(ReadOnlyMemory<T> hostData, GpuBuffer<T> deviceBuffer, int priority)
Task SynchronizeAsync()
ValueTuple<GpuBuffer<T>, Task> PrefetchAsync(ReadOnlyMemory<T> data)
void Dispose()
void Synchronize()