AdaptiveTeacherModel<T>
Models & Types ยท AiDotNet.KnowledgeDistillation.Teachers
Adaptive teacher model that wraps a base teacher and provides its logits.
Inheritance: TeacherModelBase<Vector<T>, Vector<T>, T> โ AdaptiveTeacherModel<T>
How It Works
Architecture Note: This class has been simplified to match the current architecture where temperature scaling is handled by distillation strategies, not teachers. The adaptive features (dynamic temperature adjustment based on student performance) have been removed as they belong in the strategy layer.
For adaptive temperature scaling, implement a custom IDistillationStrategy that monitors student performance and adjusts temperature accordingly.
Constructors
| Constructor | Summary |
|---|---|
AdaptiveTeacherModel(ITeacherModel<Vector<T>, Vector<T>> baseTeacher) |
Initializes a new instance of the AdaptiveTeacherModel class. |
Properties
| Property | Summary |
|---|---|
int OutputDimension { get; } |
Gets the output dimension. |
Methods
| Method | Summary |
|---|---|
Vector<T> GetLogits(Vector<T> input) |
Gets logits from the base teacher. |