DistillationLossType

Enums · AiDotNet.ContinualLearning.Strategies

Types of distillation loss functions.

Fields

Field Summary
DistillationLossType KLDivergence KL Divergence - standard distillation loss.
DistillationLossType MSE Mean Squared Error between soft targets.
DistillationLossType SoftCrossEntropy Cross-entropy with soft targets.
DistillationLossType SymmetricKL Symmetric KL Divergence (KL(T||S) + KL(S||T)).
int value__