ROCCurveFitDetectorOptions
Options & Configuration · AiDotNet.Models
Configuration options for the ROC Curve Fit Detector, which evaluates classification model quality using Receiver Operating Characteristic (ROC) curve analysis.
Inheritance: ModelOptions → ROCCurveFitDetectorOptions
For Beginners
This class helps evaluate how well your classification model performs.
Classification models predict categories (like “spam/not spam” or “will buy/won’t buy”):
- We need ways to measure how good these predictions are
- The ROC curve is a powerful tool for this evaluation
- It shows the tradeoff between correctly identifying positives and incorrectly flagging negatives
The key metric is AUC (Area Under the Curve):
- AUC ranges from 0 to 1
- 1.0 means perfect predictions
- 0.5 means the model is no better than random guessing
- Values below 0.5 suggest the model is worse than guessing
This class lets you set thresholds for what AUC values are considered:
- Good performance
- Moderate performance
- Poor performance
It also includes settings to adjust for confidence levels and data imbalance (when you have many more examples of one category than another).
How It Works
The ROC Curve Fit Detector assesses classification model performance by analyzing the Receiver Operating Characteristic (ROC) curve and its associated Area Under the Curve (AUC) metric. The ROC curve plots the True Positive Rate against the False Positive Rate at various classification thresholds, providing a comprehensive view of classifier performance across all possible decision thresholds. The AUC value ranges from 0 to 1, where 1 represents a perfect classifier and 0.5 represents a classifier that performs no better than random guessing. This class provides configuration options for thresholds that determine what constitutes good, moderate, and poor model fit based on AUC values, as well as parameters for confidence scaling and handling class imbalance. These settings allow users to customize the fit detection criteria according to their specific application requirements and domain knowledge.
Constructors
| Constructor | Summary |
|---|---|
ROCCurveFitDetectorOptions() |
Properties
| Property | Summary |
|---|---|
double BalancedDatasetThreshold { get; set; } |
Gets or sets the threshold for determining if a dataset is balanced. |
double ConfidenceScalingFactor { get; set; } |
Gets or sets the scaling factor for confidence intervals when evaluating model fit. |
double GoodFitThreshold { get; set; } |
Gets or sets the AUC threshold for considering a model to have good fit. |
double ModerateFitThreshold { get; set; } |
Gets or sets the AUC threshold for considering a model to have moderate fit. |
double PoorFitThreshold { get; set; } |
Gets or sets the AUC threshold for considering a model to have poor fit. |