TabularActorCriticOptions<T>

Options & Configuration · AiDotNet.Models.Options

Configuration options for Tabular Actor-Critic agents.

Inheritance: ModelOptions → ReinforcementLearningOptions<T> → TabularActorCriticOptions<T>

For Beginners

Actor-Critic is like having both a player (actor) and a coach (critic). The player tries different strategies, and the coach provides feedback on how well they’re working.

Best for:

  • Small discrete state/action spaces
  • Problems requiring both policy and value learning
  • More stable learning than pure policy gradient
  • Reducing variance in policy updates

Not suitable for:

  • Continuous states (use linear/neural versions)
  • Large state spaces (table becomes too big)
  • High-dimensional observations

How It Works

Tabular Actor-Critic combines policy learning (actor) with value function learning (critic) using lookup tables. The actor learns which actions to take, while the critic evaluates how good those actions are.

Constructors

Constructor Summary
TabularActorCriticOptions()

Properties

Property Summary
double ActorLearningRate { get; set; } Learning rate for the actor (policy) updates.
double CriticLearningRate { get; set; } Learning rate for the critic (value function) updates.
int ActionSize { get; set; } Size of the action space (number of possible actions).
int StateSize { get; set; } Size of the state space (number of state features).