QatTrainingHook

Models & Types · AiDotNet.Tensors.LinearAlgebra

No summary documentation available yet.

Constructors

Constructor Summary
QatTrainingHook(QuantizationBits bits, int groupSize, QuantizationScheme scheme)

Methods

Method Summary
QuantizedTensor<PackedInt4> ExportInt4(object key)
QuantizedTensor<sbyte> ExportInt8(object key)
Tensor<float> FakeQuantize(object key)
Tensor<float> RegisterFloatMaster(object key, Tensor<float> floatWeight)
void OptimizerStep(object key, ReadOnlySpan<float> floatGradient, float learningRate)