Regression

65 public types in this namespace, organized by kind.

Models & Types (61)

Type Summary
AdaBoostR2Regression<T> Implements the AdaBoost.R2 algorithm for regression problems, an ensemble learning method that combines multiple decision tree regressors to improve prediction accuracy.
BayesianRegression<T> Implements Bayesian Linear Regression with support for various kernels and uncertainty estimation.
BetaRegression<T> Beta Regression for modeling proportions and rates bounded in (0, 1).
ConditionalInferenceTreeRegression<T> Represents a conditional inference tree regression model that builds decision trees based on statistical tests.
DARTRegression<T> DART (Dropouts meet Multiple Additive Regression Trees) regression.
DecisionTreeRegression<T> Represents a decision tree regression model that predicts continuous values based on input features.
DeepHit<T> DeepHit: A deep learning approach to survival analysis with competing risks.
DeepSurv<T> DeepSurv: A deep learning approach to survival analysis using Cox proportional hazards.
ElasticNetRegression<T> Implements Elastic Net Regression (combined L1 and L2 regularized linear regression), which extends ordinary least squares by adding both L1 (Lasso) and L2 (Ridge) penalty terms.
ExplainableBoostingMachineRegression<T> Explainable Boosting Machine (EBM) for interpretable regression.
ExtremelyRandomizedTreesRegression<T> Implements an Extremely Randomized Trees regression model, which is an ensemble method that uses multiple decision trees with additional randomization for improved prediction accuracy and reduced overfitting.
GAMLSSRegression<T> GAMLSS (Generalized Additive Models for Location, Scale, and Shape) regression.
GammaRegression<T> Implements Gamma regression, a generalized linear model for positive continuous data with right-skewed distributions.
GaussianProcessRegression<T> Implements a Gaussian Process Regression model, which is a non-parametric, probabilistic approach to regression that provides uncertainty estimates along with predictions.
GeneralizedAdditiveModel<T> Implements a Generalized Additive Model (GAM) for regression, which models the target as a sum of smooth functions of individual features, allowing for flexible nonlinear relationships while maintaining interpretability.
GeneralizedLinearMixedModel<T> Generalized Linear Mixed-Effects Model (GLMM) for non-Gaussian hierarchical data.
GeneticAlgorithmRegression<T> Implements a regression model that uses genetic algorithms to optimize model parameters, mimicking the process of natural selection to find the best solution.
GradientBoostingRegression<T> Implements a Gradient Boosting Regression model, which combines multiple decision trees sequentially to create a powerful ensemble that learns from the errors of previous trees.
HistGradientBoostingRegression<T> Histogram-based Gradient Boosting Regression for fast training on large datasets.
InverseGaussianRegression<T> Implements Inverse Gaussian regression, a generalized linear model for positive continuous data with variance proportional to the cube of the mean.
IsotonicRegression<T> Implements an Isotonic Regression model, which fits a free-form line to data with the constraint that the fitted line must be non-decreasing (monotonically increasing).
KNearestNeighborsRegression<T> Implements K-Nearest Neighbors algorithm for regression, which predicts target values by averaging the values of the K closest training examples.
KernelRidgeRegression<T> Implements Kernel Ridge Regression, a powerful nonlinear regression technique that combines ridge regression with the kernel trick to capture complex nonlinear relationships.
LassoRegression<T> Implements Lasso Regression (L1 regularized linear regression), which extends ordinary least squares by adding a penalty term proportional to the absolute magnitude of the coefficients.
LinearMixedModel<T> Linear Mixed-Effects Model for hierarchical and clustered data.
LocallyWeightedRegression<T> Implements Locally Weighted Regression, a non-parametric approach that creates a different model for each prediction point based on the weighted influence of nearby training examples.
LogisticRegression<T> Represents a logistic regression model for binary classification problems.
M5ModelTree<T> Represents an M5 model tree for regression problems, combining decision tree structure with linear models at the leaves.
MixedEffectsModel<T> Mixed-Effects (Hierarchical/Multilevel) Linear Model for clustered and hierarchical data.
MultiOutputRegressor<T> Wraps a single-output regression model into a MULTI-OUTPUT one: given an n×H target, it trains H independent “head” models (one per target column, the direct-multi-horizon strategy) and predicts an n×H matrix.
MultilayerPerceptronRegression<T> Represents a multilayer perceptron (neural network) for regression problems.
MultinomialLogisticRegression<T> Represents a multinomial logistic regression model for multi-class classification problems.
MultipleRegression<T> Represents a multiple linear regression model that predicts a target value based on multiple input features.
MultivariateRegression<T> Represents a multivariate linear regression model that predicts a target value based on multiple input features.
NGBoostRegression<T> NGBoost (Natural Gradient Boosting) for probabilistic regression.
NegativeBinomialRegression<T> Represents a negative binomial regression model for count data that may exhibit overdispersion.
NeuralNetworkRegression<T> A neural network regression model that can learn complex non-linear relationships in data.
OrthogonalRegression<T> Implements orthogonal regression (also known as total least squares), which minimizes the perpendicular distance from data points to the fitted line or hyperplane.
PartialLeastSquaresRegression<T> Implements Partial Least Squares Regression (PLS), a technique that combines features from principal component analysis and multiple linear regression to handle situations with many correlated predictors.
PoissonRegression<T> Implements Poisson regression, a generalized linear model used for modeling count data and contingency tables.
PolynomialRegression<T> Implements polynomial regression, which extends linear regression by fitting a polynomial equation to the data.
PrincipalComponentRegression<T> Implements Principal Component Regression (PCR), a technique that combines principal component analysis (PCA) with linear regression to handle multicollinearity in the predictor variables.
QuantileRegressionForests<T> Implements Quantile Regression Forests, an extension of Random Forests that can predict conditional quantiles of the target variable, not just the conditional mean.
QuantileRegression<T> Implements Quantile Regression, a technique that estimates the conditional quantiles of a response variable distribution in the linear model, providing a more complete view of the relationship between variables.
RadialBasisFunctionRegression<T> Implements Radial Basis Function (RBF) Regression, a technique that uses radial basis functions as the basis for approximating complex nonlinear relationships between inputs and outputs.
RandomEffect<T> Represents a random effect specification in a mixed-effects model.
RandomForestRegression<T> Implements Random Forest Regression, an ensemble learning method that operates by constructing multiple decision trees during training and outputting the average prediction of the individual trees.
RidgeRegression<T> Implements Ridge Regression (L2 regularized linear regression), which extends ordinary least squares by adding a penalty term proportional to the squared magnitude of the coefficients.
RobustRegression<T> Represents a robust regression model that is resistant to outliers in the data.
SimpleRegression<T> Implements simple linear regression, which predicts a single output value based on a single input feature.
SplineRegression<T> Implements spline regression, which models nonlinear relationships by fitting piecewise polynomial functions.
StepwiseRegression<T> Implements stepwise regression, which automatically selects the most relevant features for the model.
SuperLearner<T> Super Learner (Stacking) ensemble for optimal model combination.
SupportVectorRegression<T> Implements Support Vector Regression (SVR), which creates a regression model by finding a hyperplane that lies within a specified margin (epsilon) of the training data.
SymbolicRegression<T> Implements symbolic regression, which discovers mathematical expressions that best describe the relationship between input features and target values.
TimeSeriesRegression<T> Represents a time series regression model that incorporates temporal dependencies, trends, and seasonality.
TweedieRegression<T> Implements Tweedie regression, a flexible generalized linear model that encompasses several distributions (Poisson, Gamma, Inverse Gaussian) as special cases based on the power parameter.
VarianceComponent<T> Represents variance components in a mixed-effects model.
VarianceDecomposition<T> Contains the full variance decomposition results from a mixed model.
WeightedRegression<T> Implements weighted regression, a variation of linear regression where each data point has a different level of importance (weight) in determining the model parameters.
ZeroInflatedRegression<T> Zero-Inflated regression for count data with excess zeros.

Base Classes (4)

Type Summary
AsyncDecisionTreeRegressionBase<T> Represents an abstract base class for asynchronous decision tree regression models.
DecisionTreeRegressionBase<T> Provides a base implementation for decision tree regression models that predict continuous values.
NonLinearRegressionBase<T> Base class for non-linear regression algorithms that provides common functionality for training and prediction.
RegressionBase<T> Provides a base implementation for regression algorithms that model the relationship between a dependent variable and one or more independent variables.