Imdb50kDataLoader<T>

Models & Types · AiDotNet.Data.Text.Benchmarks

Loads the IMDB 50k movie review sentiment analysis dataset (25k train / 25k test, binary classification).

Inheritance: DataLoaderBase<T> → InputOutputDataLoaderBase<T, Tensor<T>, Tensor<T>> → Imdb50kDataLoader<T>

How It Works

The IMDB dataset contains 50,000 movie reviews for binary sentiment classification (positive/negative). Reviews are tokenized into word indices using a simple whitespace/punctuation tokenizer, with a configurable vocabulary size and sequence length.

Constructors

Constructor Summary
Imdb50kDataLoader(Imdb50kDataLoaderOptions options) Creates a new IMDB 50k data loader.

Properties

Property Summary
int FeatureCount { get; }
int OutputDimension { get; }
int TotalCount { get; }
string Description { get; }
string Name { get; }

Methods

Method Summary
ValueTuple<IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>, IInputOutputDataLoader<T, Tensor<T>, Tensor<T>>> Split(double trainRatio, double validationRatio, int? seed)