Q8BlockGemm
Helpers & Utilities · AiDotNet.Tensors.Engines.Simd
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
bool IsSupportedK(int k) |
|
void MatMul(float[] activations, sbyte[] weightQs, float[] weightScales, float[] output, int m, int k, int n) |
|
void QuantizeRows(ReadOnlySpan<float> src, int rows, int k, Span<sbyte> dstQs, Span<float> dstScales) |
Fields
| Field | Summary |
|---|---|
int QK |