MultiGpuManager

Models & Types · AiDotNet.Tensors.Engines

No summary documentation available yet.

Implements: IDisposable

Constructors

Constructor Summary
MultiGpuManager(int[] deviceIds)

Properties

Property Summary
IReadOnlyList<GpuDevice> Devices { get; }
int DeviceCount { get; }
int PrimaryDeviceId { get; set; }

Methods

Method Summary
Dictionary<int, GpuMemoryInfo> GetMemoryUsage()
Dictionary<int, TOutput> ExecuteOnAllDevices(Dictionary<int, TInput> inputs, Func<int, TInput, TOutput> function)
Dictionary<int, T[]> DistributeData(T[] data)
Dictionary<int, Tensor<T>> DistributeTensor(Tensor<T> tensor)
Task<Dictionary<int, TOutput>> ExecuteOnAllDevicesAsync(Dictionary<int, TInput> inputs, Func<int, TInput, Task<TOutput>> function)
Task<Dictionary<int, Tensor<T>>> BroadcastParametersAsync(Tensor<T> parameters)
Tensor<T> AllReduceGradients(Dictionary<int, Tensor<T>> gradients)
int SelectBestDevice()
void Dispose()