SimilarityPreservingStrategy<T>

Models & Types ยท AiDotNet.KnowledgeDistillation.Strategies

Similarity-preserving distillation that preserves pairwise similarity structure.

Inheritance: DistillationStrategyBase<T> โ†’ SimilarityPreservingStrategy<T>

Constructors

Constructor Summary
SimilarityPreservingStrategy(double similarityWeight, double temperature, double alpha)

Methods

Method Summary
Matrix<T> ComputeGradient(Matrix<T> studentBatchOutput, Matrix<T> teacherBatchOutput, Matrix<T> trueLabelsBatch)
T ComputeLoss(Matrix<T> studentBatchOutput, Matrix<T> teacherBatchOutput, Matrix<T> trueLabelsBatch)
T ComputeSimilarityLoss(Vector<T>[] studentEmbeddings, Vector<T>[] teacherEmbeddings)