StreamingTensorPool
Models & Types · AiDotNet.Tensors.LinearAlgebra
No summary documentation available yet.
Implements: IDisposable
Constructors
| Constructor | Summary |
|---|---|
StreamingTensorPool(GpuOffloadOptions options) |
Properties
| Property | Summary |
|---|---|
int RegisteredEntryCount { get; } |
|
int ResidentEntryCount { get; } |
|
long MaxResidentBytes { get; } |
|
long ResidentBytes { get; } |
Methods
| Method | Summary |
|---|---|
ReadOnlySpan<byte> Rehydrate(long handleId) |
|
ReadOnlySpan<byte> Rehydrate(long handleId, bool isPrefetch) |
|
StreamingPoolReport GetReport() |
|
bool IsResident(long handleId) |
|
bool TryGetZeroCopyByteRange(long handleId, string path, long fileOffset, int byteLength) |
|
byte[] RehydrateInto(long handleId) |
|
long Register(byte[] data) |
|
long[] GetScheduledPrefetchTargets(int lookahead) |
|
void Dispose() |
|
void MarkAccessed(long handleId) |
|
void MarkDirty(long handleId) |
|
void ReplaceEntryData(long handleId, byte[] newData) |
|
void SetAccessSchedule(ReadOnlySpan<long> order) |
|
void Unregister(long handleId) |