FusedDequantMatmulKernels

Helpers & Utilities · AiDotNet.Tensors.Engines.Simd

No summary documentation available yet.

Methods

Method Summary
void Q4MatMul(ReadOnlySpan<float> activations, ReadOnlySpan<PackedInt4> weightsInt4, QuantizationScale weightsScale, Span<float> output, int m, int k, int n)
void Q8MatMul(ReadOnlySpan<float> activations, ReadOnlySpan<sbyte> weightsInt8, QuantizationScale weightsScale, Span<float> output, int m, int k, int n)