LearningRateSchedulerBase

Base Classes · AiDotNet.LearningRateSchedulers

Base class for learning rate schedulers providing common functionality.

Implements: ILearningRateScheduler

Known derived types: AdaptiveFitnessScheduler, ConstantLRScheduler, CosineAnnealingLRScheduler, CosineAnnealingWarmRestartsScheduler, CyclicLRScheduler, ExponentialLRScheduler, LambdaLRScheduler, LinearWarmupScheduler, MultiStepLRScheduler, NoamHoldAnnealingScheduler, NoamSchedule, OneCycleLRScheduler, PolynomialLRScheduler, ReduceOnPlateauScheduler, SequentialLRScheduler, StepLRScheduler, TriStageScheduler, WarmupStableDecayScheduler

For Beginners

This is the foundation that all learning rate schedulers build upon. It handles the common tasks like keeping track of what step we’re on and saving/loading state so that training can be resumed from a checkpoint.

How It Works

This abstract base class implements the common behavior for all learning rate schedulers, including state management, step tracking, and serialization support.

Properties

Property Summary
double BaseLearningRate { get; }
double CurrentLearningRate { get; }
int CurrentStep { get; }

Methods

Method Summary
Dictionary<string, object> GetState()
double GetLearningRateAtStep(int step)
double Step()
double Step(double metric)
void LoadState(Dictionary<string, object> state)
void Reset()