ShardingConfig
Options & Configuration · AiDotNet.Diffusion.Memory
Configuration for model sharding.
Constructors
| Constructor | Summary |
|---|---|
ShardingConfig() |
Properties
| Property | Summary |
|---|---|
ShardingStrategy Strategy { get; set; } |
Strategy for distributing layers across devices. |
bool UsePipelineParallelism { get; set; } |
Whether to use pipeline parallelism for overlapping compute and transfer. |
int MicroBatchCount { get; set; } |
Number of micro-batches for pipeline parallelism. |
int[] CustomDeviceAssignments { get; set; } |
Custom device assignments when using ShardingStrategy.Custom. |
long? MaxMemoryPerDevice { get; set; } |
Memory limit per device in bytes (for memory-balanced sharding). |