IAsyncCommunicationBackend<T>

Interfaces · AiDotNet.DistributedTraining

Extends ICommunicationBackend with non-blocking collective operations and raw transport timing diagnostics so gradient bucketing can overlap communication with backward computation.

Implements: ICommunicationBackend<T>

Known implementations: CommunicationBackendBase<T>

Properties

Property Summary
double TotalCollectiveMilliseconds { get; } Gets the cumulative wall-clock milliseconds spent inside transport collective operations since initialization or the last ResetDiagnostics call.
long CollectiveCount { get; } Gets the total number of collective operations executed since initialization or the last ResetDiagnostics call.

Methods

Method Summary
IAsyncCollectiveHandle AllReduceAsync(Vector<T> data, ReductionOperation operation) Enqueues an asynchronous in-place AllReduce on data in strict FIFO collective order.
IAsyncCollectiveResultHandle<T> AllGatherAsync(Vector<T> sendData) Enqueues an asynchronous AllGather on sendData in strict FIFO collective order.
IAsyncCollectiveResultHandle<T> ReduceScatterAsync(Vector<T> data, ReductionOperation operation) Enqueues an asynchronous ReduceScatter on data in strict FIFO collective order.
void ResetDiagnostics() Resets TotalCollectiveMilliseconds and CollectiveCount to zero.