FusedDequantMatmulKernels
Helpers & Utilities · AiDotNet.Tensors.Engines.Simd
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
void Q4MatMul(ReadOnlySpan<float> activations, ReadOnlySpan<PackedInt4> weightsInt4, QuantizationScale weightsScale, Span<float> output, int m, int k, int n) |
|
void Q8MatMul(ReadOnlySpan<float> activations, ReadOnlySpan<sbyte> weightsInt8, QuantizationScale weightsScale, Span<float> output, int m, int k, int n) |