FusedAttention<T>

Helpers & Utilities · AiDotNet.Tensors.Engines.Autodiff

No summary documentation available yet.

Methods

Method Summary
ValueTuple<Tensor<T>, Tensor<T>, Tensor<T>> Backward(Tensor<T> gradOutput, Tensor<T> query, Tensor<T> key, Tensor<T> value, FlashAttentionConfig config, Tensor<T> attentionBias, IEngine engine)
ValueTuple<Tensor<T>, Tensor<T>> Forward(Tensor<T> query, Tensor<T> key, Tensor<T> value, FlashAttentionConfig config, Tensor<T> attentionBias, IEngine engine)