Int8Quantizer
Helpers & Utilities · AiDotNet.Tensors.Engines.Simd
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
ValueTuple<double, double, double> RoundTripError(ReadOnlySpan<float> input) |
|
float ComputeSymmetricScale(ReadOnlySpan<float> data) |
|
void DequantizeInt8ToFloat32(ReadOnlySpan<sbyte> input, Span<float> output, float scale) |
|
void QuantizeActivationsPerRowToUint8(ReadOnlySpan<float> a, int m, int k, Span<byte> outU8, Span<float> outScale) |
|
void QuantizeFloat32ToInt8(ReadOnlySpan<float> input, Span<sbyte> output, float scale) |