RegularizationOrder
Enums · AiDotNet.Models.Options
Specifies which side of gradient clipping an optimizer adds its regularization on.
Fields
| Field | Summary |
|---|---|
RegularizationOrder ClipThenRegularize |
Clips the loss gradient, then adds the regularization: PyTorch’s clip_grad_norm_ followed by optimizer.step() with weight_decay. |
RegularizationOrder RegularizeThenClip |
Adds the regularization, then clips the sum: an L2 penalty in the loss under TensorFlow/Keras clipnorm. |
int value__ |