Int8Quantizer

Helpers & Utilities · AiDotNet.Tensors.Engines.Simd

No summary documentation available yet.

Methods

Method Summary
ValueTuple<double, double, double> RoundTripError(ReadOnlySpan<float> input)
float ComputeSymmetricScale(ReadOnlySpan<float> data)
void DequantizeInt8ToFloat32(ReadOnlySpan<sbyte> input, Span<float> output, float scale)
void QuantizeActivationsPerRowToUint8(ReadOnlySpan<float> a, int m, int k, Span<byte> outU8, Span<float> outScale)
void QuantizeFloat32ToInt8(ReadOnlySpan<float> input, Span<sbyte> output, float scale)