DARTRegression<T>
Models & Types · AiDotNet.Regression
DART (Dropouts meet Multiple Additive Regression Trees) regression.
Inheritance: AsyncDecisionTreeRegressionBase<T> → DARTRegression<T>
For Beginners
DART is like gradient boosting with a twist - it randomly “forgets” some of its trees when learning new ones. This prevents the model from becoming too specialized and helps it work better on new data.
Key concepts:
- Dropout: Randomly removing trees during training (like dropout in neural networks)
- Normalization: Adjusting predictions after dropout to maintain correct scale
- Ensemble: The final prediction uses all trees (no dropout at prediction time)
When to use DART over regular gradient boosting:
- Your model overfits (training error low, validation error high)
- You want more robust predictions
- You have enough time (DART is slower than regular boosting)
How It Works
DART applies dropout regularization to gradient boosting. During each iteration, a random subset of existing trees is dropped, and the new tree is fitted to residuals computed only from the non-dropped trees. This prevents overfitting and improves generalization.
Reference: Rashmi, K.V. & Gilad-Bachrach, R. (2015). “DART: Dropouts meet Multiple Additive Regression Trees”. AISTATS 2015.
Example
using AiDotNet;
using AiDotNet.Data.Loaders;
using AiDotNet.Regression;
using AiDotNet.Tensors.LinearAlgebra;
double[][] features =
{
new[] { 1.0, 2.0 }, new[] { 2.0, 3.0 }, new[] { 3.0, 4.0 },
new[] { 4.0, 5.0 }, new[] { 5.0, 6.0 }, new[] { 6.0, 7.0 }
};
double[] targets = { 3.0, 5.0, 7.0, 9.0, 11.0, 13.0 };
var result = await new AiModelBuilder<double, Matrix<double>, Vector<double>>()
.ConfigureModel(new DARTRegression<double>())
.ConfigureDataLoader(DataLoaders.FromArrays(features, targets))
.BuildAsync();
Console.WriteLine("Trained DARTRegression.");
Constructors
| Constructor | Summary |
|---|---|
DARTRegression(DARTOptions options, IRegularization<T, Matrix<T>, Vector<T>> regularization) |
Initializes a new instance of DART regression. |
Properties
| Property | Summary |
|---|---|
int NumberOfTrees { get; } |
Methods
| Method | Summary |
|---|---|
ModelMetadata<T> GetModelMetadata() |
|
Task TrainAsync(Matrix<T> x, Vector<T> y) |
|
Task<Vector<T>> PredictAsync(Matrix<T> input) |
|
Vector<T> GetTreePredictions(Vector<T> input) |
Gets the individual tree predictions for a sample. |
Vector<T> GetTreeWeights() |
Gets the tree weights. |
Vector<T> Predict(Matrix<T> input) |
Predicts values for input samples. |