IFairnessEvaluator<T>

Interfaces · AiDotNet.Interfaces

Defines an interface for evaluating fairness in machine learning models.

Known implementations: FairnessEvaluatorBase<T>

How It Works

For Beginners: This interface helps measure how fair a machine learning model is.

Fairness in machine learning means treating all groups of people equally. A fair model makes similar decisions for people with similar qualifications, regardless of sensitive attributes like race, gender, or age.

This interface provides methods to:

  • Evaluate how fair a model is across different groups
  • Measure various aspects of fairness (demographic parity, equal opportunity, etc.)
  • Compare different models to find which one is most equitable

The fairness score measures how equitable the model is. Important points:

  • Higher fairness scores can indicate more equitable treatment (depends on the metric)
  • Multiple fairness metrics exist because fairness can be defined in different ways
  • We can use these measurements to improve our models and ensure equal treatment

Properties

Property Summary
bool IsHigherFairnessBetter { get; } Indicates whether higher fairness scores represent better (more equitable) models.

Methods

Method Summary
FairnessMetrics<T> EvaluateFairness(IFullModel<T, Matrix<T>, Vector<T>> model, Matrix<T> inputs, int sensitiveFeatureIndex, Vector<T> actualLabels) Evaluates fairness of a model by analyzing its predictions across different groups.
bool IsBetterFairnessScore(T currentFairness, T bestFairness) Compares two fairness scores and determines if the current score represents better (more equitable) performance.