CompiledModelCache<T>
Models & Types · AiDotNet.Tensors.Engines.Compilation
No summary documentation available yet.
Implements: IDisposable
Constructors
| Constructor | Summary |
|---|---|
CompiledModelCache() |
Properties
| Property | Summary |
|---|---|
int InferencePlanCount { get; } |
|
int TrainingPlanCount { get; } |
Methods
| Method | Summary |
|---|---|
ICompiledPlan<T> GetOrCompileInference(Tensor<T> input, Func<Tensor<T>> forward) |
|
ICompiledPlan<T> GetOrCompileInference(Tensor<T>[] inputs, Func<Tensor<T>> forward) |
|
ICompiledPlan<T> GetOrCompileInference(int[] inputShape, Func<Tensor<T>> forward) |
|
ICompiledPlan<T> GetOrCompileInference(int[] inputShape, Func<Tensor<T>> forward, SymbolicShape symbolicShape) |
|
ICompiledTrainingPlan<T> GetOrCompileTraining(int[] inputShape, Func<Tensor<T>> forwardAndLoss, Tensor<T>[] parameters) |
|
void Dispose() |
|
void Invalidate() |