IAdam8BitWeightDecayBackend

Interfaces · AiDotNet.Tensors.Engines.DirectGpu

No summary documentation available yet.

Implements: ICompressedMomentGpuOptimizerBackend

Known implementations: CudaBackend, HipBackend, MetalBackend, OpenClBackend, VulkanBackend, WebGpuBackend

Methods

Method Summary
void Adam8BitUpdate(IGpuBuffer param, IGpuBuffer gradient, IGpuBuffer mQuant, IGpuBuffer vQuant, IGpuBuffer mScales, IGpuBuffer vScales, float learningRate, float beta1, float beta2, float epsilon, float oneMinusBeta1, float oneMinusBeta2, float biasCorrection1, float biasCorrection2, int blockSize, int paramLength, int numBlocks, float weightDecay, bool decoupledWeightDecay)