DiffusionMemoryConfig
Options & Configuration · AiDotNet.Diffusion.Memory
Configuration for diffusion model memory management.
Constructors
| Constructor |
Summary |
DiffusionMemoryConfig() |
|
Properties
| Property |
Summary |
DiffusionMemoryConfig Default { get; } |
Creates a default configuration for single-GPU training. |
DiffusionMemoryConfig MemoryEfficient { get; } |
Creates a memory-efficient configuration with aggressive checkpointing. |
DiffusionMemoryConfig SpeedOptimized { get; } |
Creates a speed-optimized configuration with less checkpointing. |
ShardingStrategy ShardingStrategy { get; set; } |
Strategy for distributing layers across devices. |
bool UseActivationPooling { get; set; } |
Whether to use activation pooling. |
bool UseGradientCheckpointing { get; set; } |
Whether to use gradient checkpointing. |
bool UsePipelineParallelism { get; set; } |
Whether to use pipeline parallelism for overlapping compute and transfer. |
int CheckpointEveryNLayers { get; set; } |
Number of layers between checkpoints. |
int MaxTensorsPerSize { get; set; } |
Maximum tensors per size class in the pool. |
int NumDevices { get; set; } |
Number of devices for model sharding. |
long MaxPoolMemoryMB { get; set; } |
Maximum memory for activation pool in MB. |
Methods
| Method |
Summary |
DiffusionMemoryConfig MultiGpu(int numDevices) |
Creates a multi-GPU configuration. |