SquadDataLoaderOptions

Options & Configuration · AiDotNet.Data.Text.Benchmarks

Configuration options for the SQuAD data loader.

How It Works

SQuAD (Stanford Question Answering Dataset) contains 100K+ question-answer pairs on Wikipedia articles. SQuAD 2.0 adds 50K unanswerable questions.

Constructors

Constructor Summary
SquadDataLoaderOptions()

Properties

Property Summary
DatasetSplit Split { get; set; } Dataset split to load.
bool AutoDownload { get; set; } Automatically download if not present.
bool Version2 { get; set; } Use SQuAD 2.0 (includes unanswerable questions).
int MaxContextLength { get; set; } Maximum context length in tokens.
int MaxQuestionLength { get; set; } Maximum question length in tokens.
int VocabularySize { get; set; } Maximum vocabulary size.
int? MaxSamples { get; set; } Optional maximum number of samples to load.
string DataPath { get; set; } Root data path.