OptimizationAlgorithmOptions<T, TInput, TOutput>
Options & Configuration · AiDotNet.Models.Options
Configuration options for optimization algorithms used in machine learning models.
Inheritance: ModelOptions → OptimizationAlgorithmOptions<T, TInput, TOutput>
Known derived types: AntColonyOptimizationOptions<T, TInput, TOutput>, BayesianOptimizerOptions<T, TInput, TOutput>, GeneticAlgorithmOptimizerOptions<T, TInput, TOutput>, GradientBasedOptimizerOptions<T, TInput, TOutput>, NelderMeadOptimizerOptions<T, TInput, TOutput>, ParticleSwarmOptimizationOptions<T, TInput, TOutput>, PowellOptimizerOptions<T, TInput, TOutput>, SimulatedAnnealingOptions<T, TInput, TOutput>
For Beginners
Think of optimization as the process of “learning” in machine learning. It’s like adjusting the knobs on a radio until you get the clearest signal. These settings control how quickly and accurately the algorithm learns from your data.
How It Works
Optimization algorithms are methods used to find the best parameters for a machine learning model by minimizing or maximizing an objective function.
Constructors
| Constructor | Summary |
|---|---|
OptimizationAlgorithmOptions() |
Creates optimization options with the documented defaults. |
OptimizationAlgorithmOptions(OptimizationAlgorithmOptions<T, TInput, TOutput> other) |
Copies every shared optimization setting. |
Properties
| Property | Summary |
|---|---|
IFitDetector<T, TInput, TOutput> FitDetector { get; set; } |
Gets or sets the fit detector to determine when a model has converged or is overfitting. |
IFitnessCalculator<T, TInput, TOutput> FitnessCalculator { get; set; } |
Gets or sets the fitness calculator to evaluate model quality during optimization. |
IModelCache<T, TInput, TOutput> ModelCache { get; set; } |
Gets or sets the model cache to store and retrieve previously evaluated models. |
ModelStatsOptions ModelStatsOptions { get; set; } |
Gets or sets the options for model statistics calculation. |
OptimizationMode OptimizationMode { get; set; } |
Gets or sets the optimization mode (feature selection, parameter tuning, or both). |
PredictionStatsOptions PredictionOptions { get; set; } |
Gets or sets the options for prediction statistics calculation. |
bool UseAdaptiveLearningRate { get; set; } |
Gets or sets whether to automatically adjust the learning rate during training based on per-epoch fitness improvement (see UpdateAdaptiveParameters). |
bool UseAdaptiveMomentum { get; set; } |
Gets or sets whether to automatically adjust the momentum during training. |
bool UseEarlyStopping { get; set; } |
Gets or sets whether to use early stopping to prevent overfitting. |
bool UseExpressionTrees { get; set; } |
Gets or sets whether to use expression trees for optimization. |
double ExplorationRate { get; set; } |
Gets or sets the exploration rate for reinforcement learning and some optimization algorithms. |
double FeatureSelectionProbability { get; set; } |
Gets or sets the probability of selecting a feature during feature selection mode. |
double InitialLearningRate { get; set; } |
Gets or sets the initial learning rate for the optimization algorithm. |
double InitialMomentum { get; set; } |
Gets or sets the initial momentum value. |
double LearningRateDecay { get; set; } |
Gets or sets the rate at which the learning rate decreases over time. |
double MaxExplorationRate { get; set; } |
Gets or sets the maximum allowed exploration rate. |
double MaxLearningRate { get; set; } |
Gets or sets the maximum allowed learning rate. |
double MaxMomentum { get; set; } |
Gets or sets the maximum allowed momentum value. |
double MinExplorationRate { get; set; } |
Gets or sets the minimum allowed exploration rate. |
double MinLearningRate { get; set; } |
Gets or sets the minimum allowed learning rate. |
double MinMomentum { get; set; } |
Gets or sets the minimum allowed momentum value. |
double MomentumDecreaseFactor { get; set; } |
Gets or sets the factor by which momentum decreases when performance worsens. |
double MomentumIncreaseFactor { get; set; } |
Gets or sets the factor by which momentum increases when performance improves. |
double ParameterAdjustmentProbability { get; set; } |
Gets or sets the probability of adjusting a parameter during parameter tuning mode. |
double ParameterAdjustmentScale { get; set; } |
Gets or sets the scale factor for parameter adjustments during optimization. |
double PlateauLearningRateReductionFactor { get; set; } |
Gets or sets the factor the learning rate is multiplied by at each plateau reduction (floored at MinLearningRate). |
double SignFlipProbability { get; set; } |
Gets or sets the probability of flipping the sign of a parameter during perturbation. |
double Tolerance { get; set; } |
Gets or sets the convergence tolerance for the optimization algorithm. |
int BadFitPatience { get; set; } |
Gets or sets the number of iterations to wait before adjusting parameters when the model is performing poorly. |
int EarlyStoppingPatience { get; set; } |
Gets or sets the number of iterations to wait before stopping if no improvement is observed. |
int MaxIterations { get; set; } |
Gets or sets the maximum number of iterations (epochs) for the optimization algorithm. |
int MaxLearningRateReductionsOnPlateau { get; set; } |
Gets or sets how many times the learning rate is REDUCED on a validation/fitness plateau before early stopping actually fires (ReduceLROnPlateau coordinated with early stopping — “reduce first, stop only once reduction stops helping”). |
int MaximumFeatures { get; set; } |
Gets or sets the maximum number of features to consider in the model. |
int MinimumFeatures { get; set; } |
Gets or sets the minimum number of features to consider in the model. |
Methods
| Method | Summary |
|---|---|
OptimizationAlgorithmOptions<T, TInput, TOutput> CreateDefaults(OptimizerType optimizerType) |
Creates default implementations for the nullable interface objects based on optimizer type. |