Quantization
Helpers & Utilities · AiDotNet.Tensors.Helpers
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
Tensor<Half> QuantizeFP16(Tensor<float> input) |
|
Tensor<float> DequantizeFP16(Tensor<Half> input) |
|
Tensor<float> DequantizeInt8(Tensor<sbyte> input, QuantizationParams qparams) |
|
Tensor<sbyte> QuantizeInt8(Tensor<float> input, QuantizationParams qparams) |
|
double ComputeQuantizationError(Tensor<float> original, Tensor<float> dequantized) |