PrioritizedReplayBuffer<T>

Models & Types · AiDotNet.ReinforcementLearning.ReplayBuffers

Prioritized experience replay buffer for reinforcement learning.

How It Works

Prioritized replay samples important experiences more frequently based on TD error. Uses sum tree data structure for efficient sampling.

Constructors

Constructor Summary
PrioritizedReplayBuffer() Initializes a new instance with default settings.
PrioritizedReplayBuffer(int capacity, int? seed) Initializes a new buffer holding up to capacity experiences.

Properties

Property Summary
int Count { get; }

Methods

Method Summary
ValueTuple<List<ValueTuple<Vector<T>, Vector<T>, T, Vector<T>, bool>>, List<int>, List<double>> Sample(int batchSize, double alpha, double beta)
void Add(Vector<T> state, Vector<T> action, T reward, Vector<T> nextState, bool done)
void UpdatePriorities(List<int> indices, List<double> priorities, double epsilon)