QuantizationType<T>

Enums · AiDotNet.LoRA.Adapters

Specifies the type of 4-bit quantization to use for base layer weights.

For Beginners

This determines how we compress numbers from full precision to 4-bit. Think of it like choosing between different image compression algorithms - each has trade-offs.

Fields

Field Summary
QuantizationType<T> INT4 4-bit integer quantization with uniform spacing (-8 to 7).
QuantizationType<T> NF4 4-bit Normal Float quantization optimized for normally distributed weights.
int value__