RegularizationOrder

Enums · AiDotNet.Models.Options

Specifies which side of gradient clipping an optimizer adds its regularization on.

Fields

Field Summary
RegularizationOrder ClipThenRegularize Clips the loss gradient, then adds the regularization: PyTorch’s clip_grad_norm_ followed by optimizer.step() with weight_decay.
RegularizationOrder RegularizeThenClip Adds the regularization, then clips the sum: an L2 penalty in the loss under TensorFlow/Keras clipnorm.
int value__