DataPipeExtensions

Helpers & Utilities · AiDotNet.Tensors.Data

No summary documentation available yet.

Methods

Method Summary
IIterableDataset<IReadOnlyList<TSample>> Batch(IIterableDataset<TSample> source, int batchSize, bool dropLast)
IIterableDataset<IReadOnlyList<TSample>> BucketBatch(IIterableDataset<TSample> source, int batchSize, int bucketCount, Func<TSample, int> key, int? bufferSize)
IIterableDataset<TOut> Map(IIterableDataset<TIn> source, Func<TIn, TOut> fn)
IIterableDataset<TSample> Concat(IIterableDataset<TSample> first, IIterableDataset<TSample> second)
IIterableDataset<TSample> Filter(IIterableDataset<TSample> source, Func<TSample, bool> predicate)
IIterableDataset<TSample> Mux(IIterableDataset<TSample>[] sources)
IIterableDataset<TSample> ShardingFilter(IIterableDataset<TSample> source, int rank, int worldSize)
IIterableDataset<TSample> Shuffle(IIterableDataset<TSample> source, int bufferSize, int? seed)
IIterableDataset<TSample>[] Demultiplex(IIterableDataset<TSample> source, int branches, Func<TSample, int> route)
IIterableDataset<ValueTuple<TA, TB>> Zip(IIterableDataset<TA> a, IIterableDataset<TB> b)