SquadDataLoaderOptions
Options & Configuration · AiDotNet.Data.Text.Benchmarks
Configuration options for the SQuAD data loader.
How It Works
SQuAD (Stanford Question Answering Dataset) contains 100K+ question-answer pairs on Wikipedia articles. SQuAD 2.0 adds 50K unanswerable questions.
Constructors
| Constructor | Summary |
|---|---|
SquadDataLoaderOptions() |
Properties
| Property | Summary |
|---|---|
DatasetSplit Split { get; set; } |
Dataset split to load. |
bool AutoDownload { get; set; } |
Automatically download if not present. |
bool Version2 { get; set; } |
Use SQuAD 2.0 (includes unanswerable questions). |
int MaxContextLength { get; set; } |
Maximum context length in tokens. |
int MaxQuestionLength { get; set; } |
Maximum question length in tokens. |
int VocabularySize { get; set; } |
Maximum vocabulary size. |
int? MaxSamples { get; set; } |
Optional maximum number of samples to load. |
string DataPath { get; set; } |
Root data path. |