DiffusionMemoryConfig

Options & Configuration · AiDotNet.Diffusion.Memory

Configuration for diffusion model memory management.

Constructors

Constructor Summary
DiffusionMemoryConfig()

Properties

Property Summary
DiffusionMemoryConfig Default { get; } Creates a default configuration for single-GPU training.
DiffusionMemoryConfig MemoryEfficient { get; } Creates a memory-efficient configuration with aggressive checkpointing.
DiffusionMemoryConfig SpeedOptimized { get; } Creates a speed-optimized configuration with less checkpointing.
ShardingStrategy ShardingStrategy { get; set; } Strategy for distributing layers across devices.
bool UseActivationPooling { get; set; } Whether to use activation pooling.
bool UseGradientCheckpointing { get; set; } Whether to use gradient checkpointing.
bool UsePipelineParallelism { get; set; } Whether to use pipeline parallelism for overlapping compute and transfer.
int CheckpointEveryNLayers { get; set; } Number of layers between checkpoints.
int MaxTensorsPerSize { get; set; } Maximum tensors per size class in the pool.
int NumDevices { get; set; } Number of devices for model sharding.
long MaxPoolMemoryMB { get; set; } Maximum memory for activation pool in MB.

Methods

Method Summary
DiffusionMemoryConfig MultiGpu(int numDevices) Creates a multi-GPU configuration.