IInferenceGraphCaptureEngine

Interfaces · AiDotNet.Tensors.Engines.Gpu

No summary documentation available yet.

Known implementations: DirectGpuTensorEngine

Properties

Property Summary
bool SupportsInferenceGraphCapture { get; }

Methods

Method Summary
IDisposable EnterResidentCaptureScope()
IntPtr CaptureGpuGraph(Action forward)
float[] DownloadResidentBuffer(Tensor<T> t)
void DestroyGpuGraph(IntPtr graphExec)
void LaunchGpuGraph(IntPtr graphExec)
void RefreshResidentInputInPlace(Tensor<T> t)