HostCompressedMomentAdam
Helpers & Utilities · AiDotNet.Tensors.Engines.Gpu
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
int BlockCount(int length, int blockSize) |
|
void Bf16Step(float[] param, float[] grad, byte[] m, byte[] v, int length, float lr, float beta1, float beta2, float epsilon, float weightDecay, int step, bool decoupledWeightDecay) |
|
void Int8Step(float[] param, float[] grad, byte[] mQuant, byte[] vQuant, float[] mScales, float[] vScales, int length, int blockSize, float lr, float beta1, float beta2, float epsilon, float weightDecay, int step, bool decoupledWeightDecay) |