WebDatasetOptions

Options & Configuration · AiDotNet.Data.Formats

Configuration options for the WebDataset loader.

Constructors

Constructor Summary
WebDatasetOptions()

Properties

Property Summary
HashSet<string> IncludeExtensions { get; set; } File extensions to include as data fields (e.g., “.jpg”, “.txt”, “.json”).
bool Shuffle { get; set; } Whether to shuffle samples after reading.
int ShuffleBufferSize { get; set; } Buffer size for shuffle (number of samples to buffer before shuffling).
int? MaxSamples { get; set; } Optional maximum number of samples to read.
int? Seed { get; set; } Optional random seed for reproducible shuffling.