CalibrationMethod

Enums · AiDotNet.Enums

Calibration methods for quantization - techniques to determine optimal scaling factors when converting high-precision models to low-precision formats.

How It Works

For Beginners: Quantization compresses AI models by using smaller numbers (e.g., 8-bit instead of 32-bit). Calibration is the process of figuring out the best way to map large numbers to small numbers without losing too much accuracy.

Think of it like adjusting a thermostat - you need to find the right scale to represent temperatures accurately. Different calibration methods use different strategies:

  • None: No calibration, uses default scaling. Fastest but least accurate.
  • MinMax: Simple approach using the min/max values seen in data. Fast and usually good enough.
  • Histogram: Analyzes distribution of values to find better scaling. More accurate than MinMax.
  • Entropy: Uses information theory (KL divergence) to minimize information loss. Most accurate but slowest.
  • MSE: Minimizes the mean squared error between original and quantized values.
  • Percentile: Ignores outliers by using percentiles instead of absolute min/max. Good for noisy data.

For most cases, MinMax or Histogram provides a good balance of speed and accuracy.

Fields

Field Summary
CalibrationMethod Entropy Entropy-based calibration - uses KL divergence to minimize information loss.
CalibrationMethod Histogram Histogram-based calibration - analyzes value distribution using percentiles.
CalibrationMethod MSE Mean Squared Error (MSE) based calibration.
CalibrationMethod MinMax Min-Max calibration - simple range-based scaling.
CalibrationMethod None No calibration - uses default symmetric scaling.
CalibrationMethod Percentile Percentile-based calibration - uses percentiles to handle outliers.
int value__