OptimizerBase

Base Classes · AiDotNet.Tensors.Engines.Optimization.Optimizers

No summary documentation available yet.

Implements: IOptimizer

Known derived types: AdaDeltaOptimizer, AdagradOptimizer, AdamOptimizer, AdamWOptimizer, AdamaxOptimizer, AsgdOptimizer, BF16AdamOptimizer, DAdaptAdamOptimizer, FP8LionOptimizer, FtrlOptimizer, LambOptimizer, LarsOptimizer, LionOptimizer, NAdamOptimizer, ProdigyOptimizer, RAdamOptimizer, RmsPropOptimizer, RpropOptimizer, SgdOptimizer, ShampooOptimizer, ShapedOptimizerBase, SparseAdam24Optimizer, SparseAdamOptimizer

Properties

Property Summary
IReadOnlyList<ParamGroup> ParamGroups { get; }

Methods

Method Summary
OptimizerStateDict StateDict()
ParamGroup AddParamGroup(IDictionary<string, double> overrides)
ParamGroup AddParameters(IEnumerable<ValueTuple<float[], float[]>> pairs)
void ClearAllSparseGradients()
void ClearSparseGradient(int paramGroupIndex, int paramIndex)
void LoadStateDict(OptimizerStateDict state)
void SetSparseGradient(int paramGroupIndex, int paramIndex, int[] indices, float[] values, bool autoClear)
void Step()
void Step(IReadOnlyDictionary<Tensor<float>, Tensor<float>> gradients)
void ZeroGrad()