TruthfulQaDataLoader<T>
Models & Types · AiDotNet.Data.Text.Benchmarks
Loads the TruthfulQA benchmark (Lin et al. 2022) — 817 truthfulness questions across 38 categories. Generation-style: question → best_answer.
Inheritance: DataLoaderBase<T> → InputOutputDataLoaderBase<T, Tensor<T>, Tensor<T>> → TruthfulQaDataLoader<T>
How It Works
Expects {DataPath}/TruthfulQA.csv. Auto-download fetches the
canonical sylinrl/TruthfulQA GitHub release. CSV columns:
Type,Category,Question,Best Answer,....
Constructors
| Constructor | Summary |
|---|---|
TruthfulQaDataLoader(TruthfulQaDataLoaderOptions options) |
Properties
| Property | Summary |
|---|---|
int FeatureCount { get; } |
|
int OutputDimension { get; } |
|
int TotalCount { get; } |
|
string Description { get; } |
|
string Name { get; } |
Methods
| Method | Summary |
|---|---|
ValueTuple<IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>> Split(double trainRatio, double validationRatio, int? seed) |