SEALAdaptiveLearningRateMode

Enums · AiDotNet.MetaLearning.Options

Specifies the mode for computing adaptive learning rates in SEAL.

For Beginners

Different ways to adjust the step size for each parameter:

  • GradientNorm: Big gradients get smaller steps (like AdaGrad)
  • RunningMean: Uses a moving average of past gradients (like RMSprop)
  • PerLayer: All parameters in a layer share the same adaptive rate

Fields

Field Summary
SEALAdaptiveLearningRateMode GradientNorm Computes adaptive learning rate based on instantaneous gradient norm.
SEALAdaptiveLearningRateMode PerLayer Computes one adaptive rate per layer (averaged across layer parameters).
SEALAdaptiveLearningRateMode RunningMean Uses exponential moving average of squared gradients.
int value__