CompiledModelCache<T>

Models & Types · AiDotNet.Tensors.Engines.Compilation

No summary documentation available yet.

Implements: IDisposable

Constructors

Constructor Summary
CompiledModelCache()

Properties

Property Summary
int InferencePlanCount { get; }
int TrainingPlanCount { get; }

Methods

Method Summary
ICompiledPlan<T> GetOrCompileInference(Tensor<T> input, Func<Tensor<T>> forward)
ICompiledPlan<T> GetOrCompileInference(Tensor<T>[] inputs, Func<Tensor<T>> forward)
ICompiledPlan<T> GetOrCompileInference(int[] inputShape, Func<Tensor<T>> forward)
ICompiledPlan<T> GetOrCompileInference(int[] inputShape, Func<Tensor<T>> forward, SymbolicShape symbolicShape)
ICompiledTrainingPlan<T> GetOrCompileTraining(int[] inputShape, Func<Tensor<T>> forwardAndLoss, Tensor<T>[] parameters)
void Dispose()
void Invalidate()