GradScaler
Models & Types · AiDotNet.Tensors.Engines.Gpu
No summary documentation available yet.
Constructors
| Constructor | Summary |
|---|---|
GradScaler(double initialScale, double growthFactor, double backoffFactor, int growthInterval) |
Properties
| Property | Summary |
|---|---|
bool FoundInfOrNan { get; } |
|
double Scale { get; } |
Methods
| Method | Summary |
|---|---|
Tensor<T> ScaleLoss(Tensor<T> loss, IEngine engine) |
|
bool ShouldStep() |
|
void Unscale(Tensor<T>[] gradients, IEngine engine) |
|
void Update() |