Quantization

Helpers & Utilities · AiDotNet.Tensors.Helpers

No summary documentation available yet.

Methods

Method Summary
Tensor<Half> QuantizeFP16(Tensor<float> input)
Tensor<float> DequantizeFP16(Tensor<Half> input)
Tensor<float> DequantizeInt8(Tensor<sbyte> input, QuantizationParams qparams)
Tensor<sbyte> QuantizeInt8(Tensor<float> input, QuantizationParams qparams)
double ComputeQuantizationError(Tensor<float> original, Tensor<float> dequantized)