FusedKernelNode

Helpers & Utilities · AiDotNet.Tensors.Engines.Gpu.Graph

No summary documentation available yet.

Inheritance: ExecutionNode → FusedKernelNode

Constructors

Constructor Summary
FusedKernelNode(FusedOperationType fusedType, Tensor<float>[] inputs, Tensor<float>[] outputs, Action<IDirectGpuBackend, IGpuStream> fusedKernelAction, IEnumerable<ExecutionNode> originalNodes, FusedActivationType? activation, Dictionary<string, object> parameters)

Properties

Property Summary
ExecutionNodeType NodeType { get; }
FusedActivationType? Activation { get; }
FusedOperationType FusedType { get; }
IReadOnlyDictionary<string, object> Parameters { get; }
IReadOnlyList<ExecutionNode> OriginalNodes { get; }
IReadOnlyList<Tensor<float>> InputTensors { get; }
IReadOnlyList<Tensor<float>> OutputTensors { get; }
bool CanFuse { get; }
int EstimatedCost { get; }
string Name { get; }

Methods

Method Summary
ExecutionNode Clone()
FusedKernelNode CreateGemmBias(Tensor<float> a, Tensor<float> b, Tensor<float> bias, Tensor<float> output, int m, int n, int k, Action<IDirectGpuBackend, IGpuStream> action, IEnumerable<ExecutionNode> originalNodes)
FusedKernelNode CreateGemmBiasActivation(Tensor<float> a, Tensor<float> b, Tensor<float> bias, Tensor<float> output, int m, int n, int k, FusedActivationType activation, Action<IDirectGpuBackend, IGpuStream> action, IEnumerable<ExecutionNode> originalNodes)
FusedKernelNode TryFuse(IReadOnlyList<KernelNode> nodes, IAsyncGpuBackend backend)
void Execute(IDirectGpuBackend backend)
void ExecuteAsync(IDirectGpuBackend backend, IGpuStream stream)