TruthfulQaDataLoader<T>

Models & Types · AiDotNet.Data.Text.Benchmarks

Loads the TruthfulQA benchmark (Lin et al. 2022) — 817 truthfulness questions across 38 categories. Generation-style: question → best_answer.

Inheritance: DataLoaderBase<T> → InputOutputDataLoaderBase<T, Tensor<T>, Tensor<T>> → TruthfulQaDataLoader<T>

How It Works

Expects {DataPath}/TruthfulQA.csv. Auto-download fetches the canonical sylinrl/TruthfulQA GitHub release. CSV columns: Type,Category,Question,Best Answer,....

Constructors

Constructor Summary
TruthfulQaDataLoader(TruthfulQaDataLoaderOptions options)

Properties

Property Summary
int FeatureCount { get; }
int OutputDimension { get; }
int TotalCount { get; }
string Description { get; }
string Name { get; }

Methods

Method Summary
ValueTuple<IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>> Split(double trainRatio, double validationRatio, int? seed)