FusedKernelNode
Helpers & Utilities · AiDotNet.Tensors.Engines.Gpu.Graph
No summary documentation available yet.
Inheritance: ExecutionNode → FusedKernelNode
Constructors
| Constructor | Summary |
|---|---|
FusedKernelNode(FusedOperationType fusedType, Tensor<float>[] inputs, Tensor<float>[] outputs, Action<IDirectGpuBackend, IGpuStream> fusedKernelAction, IEnumerable<ExecutionNode> originalNodes, FusedActivationType? activation, Dictionary<string, object> parameters) |
Properties
| Property | Summary |
|---|---|
ExecutionNodeType NodeType { get; } |
|
FusedActivationType? Activation { get; } |
|
FusedOperationType FusedType { get; } |
|
IReadOnlyDictionary<string, object> Parameters { get; } |
|
IReadOnlyList<ExecutionNode> OriginalNodes { get; } |
|
IReadOnlyList<Tensor<float>> InputTensors { get; } |
|
IReadOnlyList<Tensor<float>> OutputTensors { get; } |
|
bool CanFuse { get; } |
|
int EstimatedCost { get; } |
|
string Name { get; } |
Methods
| Method | Summary |
|---|---|
ExecutionNode Clone() |
|
FusedKernelNode CreateGemmBias(Tensor<float> a, Tensor<float> b, Tensor<float> bias, Tensor<float> output, int m, int n, int k, Action<IDirectGpuBackend, IGpuStream> action, IEnumerable<ExecutionNode> originalNodes) |
|
FusedKernelNode CreateGemmBiasActivation(Tensor<float> a, Tensor<float> b, Tensor<float> bias, Tensor<float> output, int m, int n, int k, FusedActivationType activation, Action<IDirectGpuBackend, IGpuStream> action, IEnumerable<ExecutionNode> originalNodes) |
|
FusedKernelNode TryFuse(IReadOnlyList<KernelNode> nodes, IAsyncGpuBackend backend) |
|
void Execute(IDirectGpuBackend backend) |
|
void ExecuteAsync(IDirectGpuBackend backend, IGpuStream stream) |