IAdam8BitWeightDecayBackend
Interfaces · AiDotNet.Tensors.Engines.DirectGpu
No summary documentation available yet.
Implements: ICompressedMomentGpuOptimizerBackend
Known implementations: CudaBackend, HipBackend, MetalBackend, OpenClBackend, VulkanBackend, WebGpuBackend
Methods
| Method | Summary |
|---|---|
void Adam8BitUpdate(IGpuBuffer param, IGpuBuffer gradient, IGpuBuffer mQuant, IGpuBuffer vQuant, IGpuBuffer mScales, IGpuBuffer vScales, float learningRate, float beta1, float beta2, float epsilon, float oneMinusBeta1, float oneMinusBeta2, float biasCorrection1, float biasCorrection2, int blockSize, int paramLength, int numBlocks, float weightDecay, bool decoupledWeightDecay) |