SelfSupervisedLearningOptimizerType

Enums · AiDotNet.SelfSupervisedLearning

Optimizer types optimized for SSL training.

Fields

Field Summary
SelfSupervisedLearningOptimizerType Adam Adam optimizer (good for small batches).
SelfSupervisedLearningOptimizerType AdamW AdamW with decoupled weight decay.
SelfSupervisedLearningOptimizerType LAMB LAMB (Layer-wise Adaptive Moments for Batch training) - good for transformers.
SelfSupervisedLearningOptimizerType LARS LARS (Layer-wise Adaptive Rate Scaling) - recommended for large batch SSL.
SelfSupervisedLearningOptimizerType SGD Standard SGD with momentum.
int value__