Int8WeightOnlyQuantization
Helpers & Utilities · AiDotNet.Inference.Quantization
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
QuantizedWeights QuantizePerRow(ReadOnlySpan<float> weights, int rows, int cols) |
|
QuantizedWeights QuantizePerRow(Tensor<float> weights) |