DistributedDataParallel<T>
Models & Types · AiDotNet.Tensors.Engines.Distributed
No summary documentation available yet.
Constructors
| Constructor |
Summary |
DistributedDataParallel(IProcessGroup group, DdpOptions options) |
|
Properties
| Property |
Summary |
DdpOptions Options { get; } |
|
IProcessGroup Group { get; } |
|
IReadOnlyList<Tensor<T>> Parameters { get; } |
|
IReadOnlyList<int> BucketBoundaries { get; } |
|
Methods
| Method |
Summary |
void ReduceGradients(IList<Tensor<T>> grads) |
|
void RegisterParameter(Tensor<T> param) |
|
void RegisterParameters(IEnumerable<Tensor<T>> parameters) |
|