MultiGpuManager
Models & Types · AiDotNet.Tensors.Engines
No summary documentation available yet.
Implements: IDisposable
Constructors
| Constructor | Summary |
|---|---|
MultiGpuManager(int[] deviceIds) |
Properties
| Property | Summary |
|---|---|
IReadOnlyList<GpuDevice> Devices { get; } |
|
int DeviceCount { get; } |
|
int PrimaryDeviceId { get; set; } |
Methods
| Method | Summary |
|---|---|
Dictionary<int, GpuMemoryInfo> GetMemoryUsage() |
|
Dictionary<int, TOutput> ExecuteOnAllDevices(Dictionary<int, TInput> inputs, Func<int, TInput, TOutput> function) |
|
Dictionary<int, T[]> DistributeData(T[] data) |
|
Dictionary<int, Tensor<T>> DistributeTensor(Tensor<T> tensor) |
|
Task<Dictionary<int, TOutput>> ExecuteOnAllDevicesAsync(Dictionary<int, TInput> inputs, Func<int, TInput, Task<TOutput>> function) |
|
Task<Dictionary<int, Tensor<T>>> BroadcastParametersAsync(Tensor<T> parameters) |
|
Tensor<T> AllReduceGradients(Dictionary<int, Tensor<T>> gradients) |
|
int SelectBestDevice() |
|
void Dispose() |