OptimizerBase
Base Classes · AiDotNet.Tensors.Engines.Optimization.Optimizers
No summary documentation available yet.
Implements: IOptimizer
Known derived types: AdaDeltaOptimizer, AdagradOptimizer, AdamOptimizer, AdamWOptimizer, AdamaxOptimizer, AsgdOptimizer, BF16AdamOptimizer, DAdaptAdamOptimizer, FP8LionOptimizer, FtrlOptimizer, LambOptimizer, LarsOptimizer, LionOptimizer, NAdamOptimizer, ProdigyOptimizer, RAdamOptimizer, RmsPropOptimizer, RpropOptimizer, SgdOptimizer, ShampooOptimizer, ShapedOptimizerBase, SparseAdam24Optimizer, SparseAdamOptimizer
Properties
| Property | Summary |
|---|---|
IReadOnlyList<ParamGroup> ParamGroups { get; } |
Methods
| Method | Summary |
|---|---|
OptimizerStateDict StateDict() |
|
ParamGroup AddParamGroup(IDictionary<string, double> overrides) |
|
ParamGroup AddParameters(IEnumerable<ValueTuple<float[], float[]>> pairs) |
|
void ClearAllSparseGradients() |
|
void ClearSparseGradient(int paramGroupIndex, int paramIndex) |
|
void LoadStateDict(OptimizerStateDict state) |
|
void SetSparseGradient(int paramGroupIndex, int paramIndex, int[] indices, float[] values, bool autoClear) |
|
void Step() |
|
void Step(IReadOnlyDictionary<Tensor<float>, Tensor<float>> gradients) |
|
void ZeroGrad() |