PrioritizedReplayBuffer<T>
Models & Types · AiDotNet.ReinforcementLearning.ReplayBuffers
Prioritized experience replay buffer for reinforcement learning.
How It Works
Prioritized replay samples important experiences more frequently based on TD error. Uses sum tree data structure for efficient sampling.
Constructors
| Constructor | Summary |
|---|---|
PrioritizedReplayBuffer() |
Initializes a new instance with default settings. |
PrioritizedReplayBuffer(int capacity, int? seed) |
Initializes a new buffer holding up to capacity experiences. |
Properties
| Property | Summary |
|---|---|
int Count { get; } |
Methods
| Method | Summary |
|---|---|
ValueTuple<List<ValueTuple<Vector<T>, Vector<T>, T, Vector<T>, bool>>, List<int>, List<double>> Sample(int batchSize, double alpha, double beta) |
|
void Add(Vector<T> state, Vector<T> action, T reward, Vector<T> nextState, bool done) |
|
void UpdatePriorities(List<int> indices, List<double> priorities, double epsilon) |