IAsyncCommunicationBackend<T>
Interfaces · AiDotNet.DistributedTraining
Extends ICommunicationBackend with non-blocking collective operations and raw transport
timing diagnostics so gradient bucketing can overlap communication with backward computation.
Implements: ICommunicationBackend<T>
Known implementations: CommunicationBackendBase<T>
Properties
| Property | Summary |
|---|---|
double TotalCollectiveMilliseconds { get; } |
Gets the cumulative wall-clock milliseconds spent inside transport collective operations since initialization or the last ResetDiagnostics call. |
long CollectiveCount { get; } |
Gets the total number of collective operations executed since initialization or the last ResetDiagnostics call. |
Methods
| Method | Summary |
|---|---|
IAsyncCollectiveHandle AllReduceAsync(Vector<T> data, ReductionOperation operation) |
Enqueues an asynchronous in-place AllReduce on data in strict FIFO collective order. |
IAsyncCollectiveResultHandle<T> AllGatherAsync(Vector<T> sendData) |
Enqueues an asynchronous AllGather on sendData in strict FIFO collective order. |
IAsyncCollectiveResultHandle<T> ReduceScatterAsync(Vector<T> data, ReductionOperation operation) |
Enqueues an asynchronous ReduceScatter on data in strict FIFO collective order. |
void ResetDiagnostics() |
Resets TotalCollectiveMilliseconds and CollectiveCount to zero. |