AdaptiveTeacherModel<T>

Models & Types ยท AiDotNet.KnowledgeDistillation.Teachers

Adaptive teacher model that wraps a base teacher and provides its logits.

Inheritance: TeacherModelBase<Vector<T>, Vector<T>, T> โ†’ AdaptiveTeacherModel<T>

How It Works

Architecture Note: This class has been simplified to match the current architecture where temperature scaling is handled by distillation strategies, not teachers. The adaptive features (dynamic temperature adjustment based on student performance) have been removed as they belong in the strategy layer.

For adaptive temperature scaling, implement a custom IDistillationStrategy that monitors student performance and adjusts temperature accordingly.

Constructors

Constructor Summary
AdaptiveTeacherModel(ITeacherModel<Vector<T>, Vector<T>> baseTeacher) Initializes a new instance of the AdaptiveTeacherModel class.

Properties

Property Summary
int OutputDimension { get; } Gets the output dimension.

Methods

Method Summary
Vector<T> GetLogits(Vector<T> input) Gets logits from the base teacher.