ArcDataLoader<T>
Models & Types · AiDotNet.Data.Text.Benchmarks
Loads the AI2 Reasoning Challenge (ARC) multiple-choice science QA benchmark (Clark et al. 2018) — Easy or Challenge variant.
Inheritance: DataLoaderBase<T> → InputOutputDataLoaderBase<T, Tensor<T>, Tensor<T>> → ArcDataLoader<T>
How It Works
Expects:
Auto-download fetches the canonical AllenAI release. Handles both 4-way and 5-way questions (ARC has a small fraction of 5-choice items); the 5th choice is treated as an out-of-distribution distractor when truncated. Features Tensor[N, 4, MaxSequenceLength]; one-hot labels Tensor[N, 4].
Constructors
| Constructor | Summary |
|---|---|
ArcDataLoader(ArcDataLoaderOptions options) |
Creates a new ARC data loader. |
Properties
| Property | Summary |
|---|---|
int FeatureCount { get; } |
|
int OutputDimension { get; } |
|
int TotalCount { get; } |
|
string Description { get; } |
|
string Name { get; } |
Methods
| Method | Summary |
|---|---|
ValueTuple<IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>> Split(double trainRatio, double validationRatio, int? seed) |