LSTDOptions<T>
Options & Configuration · AiDotNet.Models.Options
Configuration options for LSTD (Least-Squares Temporal Difference) agents.
Inheritance: ModelOptions → ReinforcementLearningOptions<T> → LSTDOptions<T>
For Beginners
LSTD is like solving a math equation directly instead of guessing and checking. It collects experiences and then computes the best weights all at once using linear algebra, rather than slowly adjusting them one step at a time.
Best for:
- Limited data scenarios (sample efficient)
- Batch learning from fixed datasets
- When you have computational power for matrix operations
- Problems where convergence speed matters
Not suitable for:
- Very large feature spaces (matrix becomes huge)
- Online learning (needs batches)
- When computational resources are limited
- Non-linear function approximation needs
How It Works
LSTD solves for the optimal linear weights directly using matrix operations (A^-1 * b) rather than incremental updates. This provides more sample-efficient learning but requires solving a linear system.
Constructors
| Constructor | Summary |
|---|---|
LSTDOptions() |
Properties
| Property | Summary |
|---|---|
double RegularizationParam { get; set; } |
Regularization parameter to prevent overfitting and ensure numerical stability. |
int ActionSize { get; set; } |
Size of the action space (number of possible actions). |
int FeatureSize { get; set; } |
Number of features in the state representation. |