StreamingTensorPool

Models & Types · AiDotNet.Tensors.LinearAlgebra

No summary documentation available yet.

Implements: IDisposable

Constructors

Constructor Summary
StreamingTensorPool(GpuOffloadOptions options)

Properties

Property Summary
int RegisteredEntryCount { get; }
int ResidentEntryCount { get; }
long MaxResidentBytes { get; }
long ResidentBytes { get; }

Methods

Method Summary
ReadOnlySpan<byte> Rehydrate(long handleId)
ReadOnlySpan<byte> Rehydrate(long handleId, bool isPrefetch)
StreamingPoolReport GetReport()
bool IsResident(long handleId)
bool TryGetZeroCopyByteRange(long handleId, string path, long fileOffset, int byteLength)
byte[] RehydrateInto(long handleId)
long Register(byte[] data)
long[] GetScheduledPrefetchTargets(int lookahead)
void Dispose()
void MarkAccessed(long handleId)
void MarkDirty(long handleId)
void ReplaceEntryData(long handleId, byte[] newData)
void SetAccessSchedule(ReadOnlySpan<long> order)
void Unregister(long handleId)