PipelineOperation
Models & Types · AiDotNet.Interfaces
Represents a single operation in the pipeline schedule.
For Beginners
This is one instruction in the schedule, like “do forward pass on micro-batch #3” or “do backward pass on micro-batch #1”.
How It Works
Zero Bubble schedules split the backward pass into two operations: BackwardInput (compute activation gradients, on the critical path) and BackwardWeight (compute weight gradients, can fill bubbles). Traditional schedules use the combined Backward type.
Constructors
| Constructor | Summary |
|---|---|
PipelineOperation() |
Properties
| Property | Summary |
|---|---|
PipelineOperationType Type { get; set; } |
Gets the type of pipeline operation (Forward, Backward, BackwardInput, or BackwardWeight). |
bool IsCooldown { get; set; } |
Gets whether this is a cooldown operation (part of pipeline drain phase). |
bool IsWarmup { get; set; } |
Gets whether this is a warmup operation (part of pipeline fill phase). |
int MicroBatchIndex { get; set; } |
Gets the micro-batch index this operation works on. |
int VirtualStageIndex { get; set; } |
Gets the virtual stage index for multi-stage schedules (0-based within this rank). |