HyperparameterOptimizerBase<T, TInput, TOutput>

Base Classes · AiDotNet.HyperparameterOptimization

Base class for hyperparameter optimization algorithms.

Implements: IHyperparameterOptimizer<T, TInput, TOutput>

Known derived types: ASHAOptimizer<T, TInput, TOutput>, BayesianOptimizer<T, TInput, TOutput>, GridSearchOptimizer<T, TInput, TOutput>, HyperbandOptimizer<T, TInput, TOutput>, PopulationBasedTrainingOptimizer<T, TInput, TOutput>, RandomSearchOptimizer<T, TInput, TOutput>

How It Works

For Beginners: This abstract base class provides common functionality for hyperparameter optimization. It handles trial management, result tracking, and provides helper methods for finding best trials while leaving the specific optimization strategy to derived classes.

Key features:

  • Thread-safe trial management
  • Consistent result aggregation
  • Helper methods for finding best trials
  • Support for both maximization and minimization objectives

Methods

Method Summary
Dictionary<string, object> SuggestNext(HyperparameterTrial<T> trial) Suggests the next hyperparameter configuration to try.
HyperparameterOptimizationResult<T> Optimize(Func<Dictionary<string, object>, T> objectiveFunction, HyperparameterSearchSpace searchSpace, int nTrials) Searches for the best hyperparameter configuration.
HyperparameterOptimizationResult<T> OptimizeModel(IModel<TInput, TOutput, TMetadata> model, ValueTuple<TInput, TOutput> trainingData, ValueTuple<TInput, TOutput> validationData, HyperparameterSearchSpace searchSpace, int nTrials) Searches for the best hyperparameters for a specific model.
HyperparameterTrial<T> GetBestTrial() Gets the best trial from the optimization.
List<HyperparameterTrial<T>> GetAllTrials() Gets all trials performed during optimization.
List<HyperparameterTrial<T>> GetTrials(Func<HyperparameterTrial<T>, bool> filter) Gets trials that meet a certain criteria.
bool ShouldPrune(HyperparameterTrial<T> trial, int step, T intermediateValue) Determines if a trial should be pruned (stopped early).
void ReportTrial(HyperparameterTrial<T> trial, T objectiveValue) Reports the result of a trial.