Q8BlockGemm

Helpers & Utilities · AiDotNet.Tensors.Engines.Simd

No summary documentation available yet.

Methods

Method Summary
bool IsSupportedK(int k)
void MatMul(float[] activations, sbyte[] weightQs, float[] weightScales, float[] output, int m, int k, int n)
void QuantizeRows(ReadOnlySpan<float> src, int rows, int k, Span<sbyte> dstQs, Span<float> dstScales)

Fields

Field Summary
int QK