DuelingDQNOptions<T>
Options & Configuration ยท AiDotNet.Models.Options
Configuration options for Dueling DQN agent.
Inheritance: ModelOptions โ DuelingDQNOptions<T>
Constructors
| Constructor | Summary |
|---|---|
DuelingDQNOptions() |
Creates options with the default values. |
Properties
| Property | Summary |
|---|---|
ILossFunction<T> LossFunction { get; set; } |
Loss function used to fit Q-values to their TD targets. |
List<int> AdvantageStreamLayers { get; set; } |
Hidden layer sizes of the advantage stream, which estimates how much better each action is than average. |
List<int> SharedLayers { get; set; } |
Hidden layer sizes of the shared trunk that feeds both streams. |
List<int> ValueStreamLayers { get; set; } |
Hidden layer sizes of the value stream, which estimates the value of the state. |
T DiscountFactor { get; set; } |
Discount factor (gamma) applied to future rewards. |
T LearningRate { get; set; } |
Learning rate of the optimizer. |
double EpsilonDecay { get; set; } |
Rate at which the exploration rate decays from EpsilonStart toward EpsilonEnd. |
double EpsilonEnd { get; set; } |
Final, minimum exploration rate for epsilon-greedy action selection. |
double EpsilonStart { get; set; } |
Initial exploration rate for epsilon-greedy action selection. |
int ActionSize { get; set; } |
Number of discrete actions, or the dimension of the action vector for a continuous action space. |
int BatchSize { get; set; } |
Number of samples in each training batch. |
int ReplayBufferSize { get; set; } |
Maximum number of transitions kept in the replay buffer. |
int StateSize { get; set; } |
Number of features in one observation of the environment state. |
int TargetUpdateFrequency { get; set; } |
Number of training steps between target-network updates. |
int WarmupSteps { get; set; } |
Number of environment steps collected before learning starts. |