DDPGOptions<T>

Options & Configuration ยท AiDotNet.Models.Options

Configuration options for DDPG agent.

Inheritance: ModelOptions โ†’ DDPGOptions<T>

Constructors

Constructor Summary
DDPGOptions() Creates options with the default values.

Properties

Property Summary
ILossFunction<T> CriticLossFunction { get; set; } Loss function used to train the critic network.
List<int> ActorHiddenLayers { get; set; } Hidden layer sizes of the actor network.
List<int> CriticHiddenLayers { get; set; } Hidden layer sizes of the critic network.
T ActorLearningRate { get; set; } Learning rate of the actor network.
T CriticLearningRate { get; set; } Learning rate of the critic network.
T DiscountFactor { get; set; } Discount factor (gamma) applied to future rewards.
T TargetUpdateTau { get; set; } Soft-update coefficient for the target networks: each update moves them this fraction of the way toward the online networks.
double ExplorationNoise { get; set; } Standard deviation of the Gaussian noise added to actions for exploration.
int ActionSize { get; set; } Number of discrete actions, or the dimension of the action vector for a continuous action space.
int BatchSize { get; set; } Number of samples in each training batch.
int ReplayBufferSize { get; set; } Maximum number of transitions kept in the replay buffer.
int StateSize { get; set; } Number of features in one observation of the environment state.
int WarmupSteps { get; set; } Number of environment steps collected before learning starts.