PipelineOperation

Models & Types · AiDotNet.Interfaces

Represents a single operation in the pipeline schedule.

For Beginners

This is one instruction in the schedule, like “do forward pass on micro-batch #3” or “do backward pass on micro-batch #1”.

How It Works

Zero Bubble schedules split the backward pass into two operations: BackwardInput (compute activation gradients, on the critical path) and BackwardWeight (compute weight gradients, can fill bubbles). Traditional schedules use the combined Backward type.

Constructors

Constructor Summary
PipelineOperation()

Properties

Property Summary
PipelineOperationType Type { get; set; } Gets the type of pipeline operation (Forward, Backward, BackwardInput, or BackwardWeight).
bool IsCooldown { get; set; } Gets whether this is a cooldown operation (part of pipeline drain phase).
bool IsWarmup { get; set; } Gets whether this is a warmup operation (part of pipeline fill phase).
int MicroBatchIndex { get; set; } Gets the micro-batch index this operation works on.
int VirtualStageIndex { get; set; } Gets the virtual stage index for multi-stage schedules (0-based within this rank).