FlashAttention2
Helpers & Utilities · AiDotNet.Tensors.Engines.Autodiff
No summary documentation available yet.
Methods
| Method | Summary |
|---|---|
ValueTuple<Tensor<float>, Tensor<float>, Tensor<float>> Backward(Tensor<float> gradOutput, Tensor<float> query, Tensor<float> key, Tensor<float> value, Tensor<float> output, float[] logsumexp, int blockSizeQ, int blockSizeKV, double? scale, bool isCausal, int queryOffset, Tensor<float> attentionBias) |
|
ValueTuple<Tensor<float>, float[]> Forward(Tensor<float> query, Tensor<float> key, Tensor<float> value, int blockSizeQ, int blockSizeKV, double? scale, bool isCausal, int queryOffset, Tensor<float> attentionBias) |