PowellOptimizerOptions<T, TInput, TOutput>

Options & Configuration · AiDotNet.Models.Options

Configuration options for Powell’s method, a derivative-free optimization algorithm used for finding the minimum of a function without requiring gradient information.

Inheritance: ModelOptions → OptimizationAlgorithmOptions<T, TInput, TOutput> → PowellOptimizerOptions<T, TInput, TOutput>

For Beginners

Powell’s method is a way to find the lowest point (or minimum) of a function without needing to calculate its slope.

Imagine you’re trying to find the lowest point in a hilly landscape while blindfolded:

  • Gradient-based methods are like feeling which way is downhill and stepping that way
  • But what if you can’t tell which way is downhill? That’s where Powell’s method helps

What Powell’s method does:

  • It tries stepping in one direction, then another, then another
  • It keeps track of which directions led to the most improvement
  • It combines these successful directions to create new search directions
  • It continues this process until it can’t make further progress

Think of it like exploring a dark room:

  • First, you walk north for a while until you hit something
  • Then east, then south, then west
  • Based on what you found, you decide which directions to try next
  • You keep exploring until you’re confident you’ve found what you’re looking for

This class lets you configure how Powell’s method explores the function landscape - how big its steps are, how small they can get, and how it adapts as it explores.

How It Works

Powell’s method is a powerful optimization technique that does not require gradient information, making it suitable for optimizing functions where derivatives are unavailable, unreliable, or expensive to compute. The algorithm works by performing a series of one-dimensional minimizations along different directions, sequentially updating these directions based on the progress made. Unlike gradient-based methods like gradient descent, Powell’s method can navigate complex objective function landscapes even when the gradient is not available. It is particularly effective for smooth, continuous functions with moderate dimensionality. The method’s efficiency and reliability can be significantly affected by the step size parameters and adaptation strategy specified in this options class.

Constructors

Constructor Summary
PowellOptimizerOptions()

Properties

Property Summary
bool UseAdaptiveStepSize { get; set; } Gets or sets a value indicating whether the algorithm should adaptively adjust step sizes based on optimization progress.
double AdaptationRate { get; set; } Gets or sets the rate at which the step size adapts when adaptive step sizing is enabled.
double InitialStepSize { get; set; } Gets or sets the initial step size used by the algorithm when exploring the function space.
double MaxStepSize { get; set; } Gets or sets the maximum step size allowed during the optimization process.
double MinStepSize { get; set; } Gets or sets the minimum step size allowed during optimization, serving as a stopping criterion.