ElasticNetLoss<T>
Models & Types · AiDotNet.LossFunctions
Implements the Elastic Net Loss function, which combines Mean Squared Error with L1 and L2 regularization.
Inheritance: LossFunctionBase<T> → ElasticNetLoss<T>
For Beginners
Elastic Net Loss combines the Mean Squared Error (which measures prediction accuracy) with two types of regularization (which prevent overfitting):
- L1 regularization (also called Lasso): Helps select only the most important features by pushing some weights to zero
- L2 regularization (also called Ridge): Prevents any single weight from becoming too large
The formula is: MSE + a * [l1Ratio * |weights|_1 + (1-l1Ratio) * 0.5 * |weights|_2²] Where:
- MSE is the Mean Squared Error
- |weights|_1 is the L1 norm (sum of absolute values)
- |weights|_2² is the squared L2 norm (sum of squared values)
- a is the regularization strength
- l1Ratio controls the mix between L1 and L2 regularization
The l1Ratio parameter (between 0 and 1) controls the balance:
- When l1Ratio = 1: Only L1 regularization is used (Lasso)
- When l1Ratio = 0: Only L2 regularization is used (Ridge)
- Values in between: A mix of both (Elastic Net)
This loss function is particularly useful when:
- You have many correlated features
- You want to perform feature selection (L1 component)
- You still want the stability of L2 regularization
- You want to balance between model simplicity and prediction accuracy
Example
using AiDotNet.LossFunctions;
using AiDotNet.Tensors.LinearAlgebra;
var loss = new ElasticNetLoss<float>();
var predicted = new Vector<float>(new[] { 0.9f, 0.2f, 0.7f });
var actual = new Vector<float>(new[] { 1.0f, 0.0f, 1.0f });
float value = loss.CalculateLoss(predicted, actual);
Console.WriteLine($"ElasticNetLoss = {value:F4}");
Constructors
| Constructor | Summary |
|---|---|
ElasticNetLoss(double l1Ratio, double alpha) |
Initializes a new instance of the ElasticNetLoss class. |
Methods
| Method | Summary |
|---|---|
T CalculateLoss(Vector<T> predicted, Vector<T> actual) |
Calculates the Elastic Net Loss between predicted and actual values. |
Tensor<T> ComputeTapeLoss(Tensor<T> predicted, Tensor<T> target) |
|
ValueTuple<T, Tensor<T>> CalculateLossAndGradientGpu(Tensor<T> predicted, Tensor<T> actual) |
Calculates both Elastic Net loss and gradient on GPU in a single efficient pass. |