HostCompressedMomentAdam

Helpers & Utilities · AiDotNet.Tensors.Engines.Gpu

No summary documentation available yet.

Methods

Method Summary
int BlockCount(int length, int blockSize)
void Bf16Step(float[] param, float[] grad, byte[] m, byte[] v, int length, float lr, float beta1, float beta2, float epsilon, float weightDecay, int step, bool decoupledWeightDecay)
void Int8Step(float[] param, float[] grad, byte[] mQuant, byte[] vQuant, float[] mScales, float[] vScales, int length, int blockSize, float lr, float beta1, float beta2, float epsilon, float weightDecay, int step, bool decoupledWeightDecay)