MetaEvaluationResult<T>
Models & Types · AiDotNet.Models.Results
Results from evaluating a meta-learner across multiple tasks.
For Beginners
Meta-learning evaluation tests how well your model can quickly learn new tasks.
This result tells you:
- Average accuracy: How well the model performs on new tasks after quick adaptation
- Consistency: How much performance varies across different tasks (standard deviation)
- Confidence: Statistical confidence intervals for the results
- Per-task details: Individual task results for deep analysis
For example, if you’re doing 5-way 1-shot classification:
- You sample many test tasks (e.g., 100 tasks)
- For each task, the model sees 1 example per class and must classify new examples
- This result aggregates accuracy and loss across all those tasks
- Higher mean accuracy and lower standard deviation indicate better meta-learning
How It Works
This class aggregates evaluation metrics from multiple tasks to assess meta-learning performance. It uses the existing BasicStats infrastructure to provide comprehensive statistical analysis of how well the meta-learner adapts to new tasks.
Constructors
| Constructor | Summary |
|---|---|
MetaEvaluationResult(Vector<T> taskAccuracies, Vector<T> taskLosses, TimeSpan evaluationTime, Dictionary<string, T> additionalMetrics) |
Initializes a new instance with task results and calculates all statistics. |
Properties
| Property | Summary |
|---|---|
BasicStats<T> AccuracyStats { get; } |
Gets comprehensive statistics for accuracy across all evaluated tasks. |
BasicStats<T> LossStats { get; } |
Gets comprehensive statistics for loss across all evaluated tasks. |
Dictionary<string, T> AdditionalMetrics { get; } |
Gets algorithm-specific metrics that don’t fit standard categories. |
TimeSpan EvaluationTime { get; } |
Gets the total time taken for evaluation. |
Vector<T> PerTaskAccuracies { get; } |
Gets the individual accuracy values for each evaluated task. |
Vector<T> PerTaskLosses { get; } |
Gets the individual loss values for each evaluated task. |
int NumTasks { get; } |
Gets the number of tasks used for evaluation. |
Methods
| Method | Summary |
|---|---|
ValueTuple<T, T> GetAccuracyConfidenceInterval() |
Calculates the 95% confidence interval for mean accuracy. |
ValueTuple<T, T> GetLossConfidenceInterval() |
Calculates the 95% confidence interval for mean loss. |
string GenerateReport() |
Generates a formatted summary report of the evaluation results. |