ICompressedMomentGpuOptimizerBackend
Interfaces · AiDotNet.Tensors.Engines.DirectGpu
No summary documentation available yet.
Implements: IDirectGpuBackend
Known implementations: IAdam8BitWeightDecayBackend
Methods
| Method | Summary |
|---|---|
void Adam8BitUpdate(IGpuBuffer param, IGpuBuffer gradient, IGpuBuffer mQuant, IGpuBuffer vQuant, IGpuBuffer mScales, IGpuBuffer vScales, float learningRate, float beta1, float beta2, float epsilon, float oneMinusBeta1, float oneMinusBeta2, float biasCorrection1, float biasCorrection2, int blockSize, int paramLength, int numBlocks) |
|
void AdamUpdateBf16(IGpuBuffer param, IGpuBuffer gradient, IGpuBuffer m, IGpuBuffer v, float learningRate, float beta1, float beta2, float epsilon, float weightDecay, int step, int size) |
|
void AdamWUpdateBf16(IGpuBuffer param, IGpuBuffer gradient, IGpuBuffer m, IGpuBuffer v, float learningRate, float beta1, float beta2, float epsilon, float weightDecay, int step, int size) |