DistributedDataParallel<T>

Models & Types · AiDotNet.Tensors.Engines.Distributed

No summary documentation available yet.

Constructors

Constructor Summary
DistributedDataParallel(IProcessGroup group, DdpOptions options)

Properties

Property Summary
DdpOptions Options { get; }
IProcessGroup Group { get; }
IReadOnlyList<Tensor<T>> Parameters { get; }
IReadOnlyList<int> BucketBoundaries { get; }

Methods

Method Summary
void ReduceGradients(IList<Tensor<T>> grads)
void RegisterParameter(Tensor<T> param)
void RegisterParameters(IEnumerable<Tensor<T>> parameters)