DuelingDQNOptions<T>

Options & Configuration ยท AiDotNet.Models.Options

Configuration options for Dueling DQN agent.

Inheritance: ModelOptions โ†’ DuelingDQNOptions<T>

Constructors

Constructor Summary
DuelingDQNOptions() Creates options with the default values.

Properties

Property Summary
ILossFunction<T> LossFunction { get; set; } Loss function used to fit Q-values to their TD targets.
List<int> AdvantageStreamLayers { get; set; } Hidden layer sizes of the advantage stream, which estimates how much better each action is than average.
List<int> SharedLayers { get; set; } Hidden layer sizes of the shared trunk that feeds both streams.
List<int> ValueStreamLayers { get; set; } Hidden layer sizes of the value stream, which estimates the value of the state.
T DiscountFactor { get; set; } Discount factor (gamma) applied to future rewards.
T LearningRate { get; set; } Learning rate of the optimizer.
double EpsilonDecay { get; set; } Rate at which the exploration rate decays from EpsilonStart toward EpsilonEnd.
double EpsilonEnd { get; set; } Final, minimum exploration rate for epsilon-greedy action selection.
double EpsilonStart { get; set; } Initial exploration rate for epsilon-greedy action selection.
int ActionSize { get; set; } Number of discrete actions, or the dimension of the action vector for a continuous action space.
int BatchSize { get; set; } Number of samples in each training batch.
int ReplayBufferSize { get; set; } Maximum number of transitions kept in the replay buffer.
int StateSize { get; set; } Number of features in one observation of the environment state.
int TargetUpdateFrequency { get; set; } Number of training steps between target-network updates.
int WarmupSteps { get; set; } Number of environment steps collected before learning starts.