SimilarityPreservingStrategy<T>
Models & Types ยท AiDotNet.KnowledgeDistillation.Strategies
Similarity-preserving distillation that preserves pairwise similarity structure.
Inheritance: DistillationStrategyBase<T> โ SimilarityPreservingStrategy<T>
Constructors
| Constructor | Summary |
|---|---|
SimilarityPreservingStrategy(double similarityWeight, double temperature, double alpha) |
Methods
| Method | Summary |
|---|---|
Matrix<T> ComputeGradient(Matrix<T> studentBatchOutput, Matrix<T> teacherBatchOutput, Matrix<T> trueLabelsBatch) |
|
T ComputeLoss(Matrix<T> studentBatchOutput, Matrix<T> teacherBatchOutput, Matrix<T> trueLabelsBatch) |
|
T ComputeSimilarityLoss(Vector<T>[] studentEmbeddings, Vector<T>[] teacherEmbeddings) |