MetaEvaluationResult<T>

Models & Types · AiDotNet.Models.Results

Results from evaluating a meta-learner across multiple tasks.

For Beginners

Meta-learning evaluation tests how well your model can quickly learn new tasks.

This result tells you:

  • Average accuracy: How well the model performs on new tasks after quick adaptation
  • Consistency: How much performance varies across different tasks (standard deviation)
  • Confidence: Statistical confidence intervals for the results
  • Per-task details: Individual task results for deep analysis

For example, if you’re doing 5-way 1-shot classification:

  • You sample many test tasks (e.g., 100 tasks)
  • For each task, the model sees 1 example per class and must classify new examples
  • This result aggregates accuracy and loss across all those tasks
  • Higher mean accuracy and lower standard deviation indicate better meta-learning

How It Works

This class aggregates evaluation metrics from multiple tasks to assess meta-learning performance. It uses the existing BasicStats infrastructure to provide comprehensive statistical analysis of how well the meta-learner adapts to new tasks.

Constructors

Constructor Summary
MetaEvaluationResult(Vector<T> taskAccuracies, Vector<T> taskLosses, TimeSpan evaluationTime, Dictionary<string, T> additionalMetrics) Initializes a new instance with task results and calculates all statistics.

Properties

Property Summary
BasicStats<T> AccuracyStats { get; } Gets comprehensive statistics for accuracy across all evaluated tasks.
BasicStats<T> LossStats { get; } Gets comprehensive statistics for loss across all evaluated tasks.
Dictionary<string, T> AdditionalMetrics { get; } Gets algorithm-specific metrics that don’t fit standard categories.
TimeSpan EvaluationTime { get; } Gets the total time taken for evaluation.
Vector<T> PerTaskAccuracies { get; } Gets the individual accuracy values for each evaluated task.
Vector<T> PerTaskLosses { get; } Gets the individual loss values for each evaluated task.
int NumTasks { get; } Gets the number of tasks used for evaluation.

Methods

Method Summary
ValueTuple<T, T> GetAccuracyConfidenceInterval() Calculates the 95% confidence interval for mean accuracy.
ValueTuple<T, T> GetLossConfidenceInterval() Calculates the 95% confidence interval for mean loss.
string GenerateReport() Generates a formatted summary report of the evaluation results.