MathDataLoaderOptions

Options & Configuration ยท AiDotNet.Data.Text.Benchmarks

Configuration options for the Hendrycks MATH benchmark loader.

How It Works

MATH (Hendrycks et al. 2021) โ€” 12,500 competition math problems (7,500 train / 5,000 test) drawn from AMC/AIME/HMMT competitions across 7 subject areas (algebra, counting/probability, geometry, intermediate algebra, number theory, prealgebra, precalculus). Each problem has a difficulty level (1..5) and a step-by-step LaTeX-formatted reference solution. Standard advanced math reasoning benchmark.

Constructors

Constructor Summary
MathDataLoaderOptions()

Properties

Property Summary
DatasetSplit Split { get; set; } Gets or sets which split of the dataset is loaded.
bool AutoDownload { get; set; } Gets or sets whether the dataset is downloaded into the data directory when it is not there.
int MaxProblemLength { get; set; } Gets or sets the token length each problem statement is padded or truncated to.
int MaxSolutionLength { get; set; } Gets or sets the token length each solution is padded or truncated to.
int VocabularySize { get; set; } Gets or sets the most distinct tokens in the vocabulary built from the loaded text.
int? LevelFilter { get; set; } Difficulty level filter (1..5).
int? MaxSamples { get; set; } Gets or sets the most samples loaded; null loads the whole split.
string DataPath { get; set; } Gets or sets the dataset root directory; null uses the default data directory for this dataset.
string SubjectFilter { get; set; } Optional subject filter (case-insensitive substring of subject directory name).

Methods

Method Summary
void Validate() Validates that all option values are within acceptable ranges.