ShardingConfig

Options & Configuration · AiDotNet.Diffusion.Memory

Configuration for model sharding.

Constructors

Constructor Summary
ShardingConfig()

Properties

Property Summary
ShardingStrategy Strategy { get; set; } Strategy for distributing layers across devices.
bool UsePipelineParallelism { get; set; } Whether to use pipeline parallelism for overlapping compute and transfer.
int MicroBatchCount { get; set; } Number of micro-batches for pipeline parallelism.
int[] CustomDeviceAssignments { get; set; } Custom device assignments when using ShardingStrategy.Custom.
long? MaxMemoryPerDevice { get; set; } Memory limit per device in bytes (for memory-balanced sharding).