FlashAttentionConfig

Options & Configuration · AiDotNet.Tensors.Engines.Autodiff

No summary documentation available yet.

Constructors

Constructor Summary
FlashAttentionConfig()

Properties

Property Summary
FlashAttentionConfig Default { get; }
bool Float32Precision { get; set; }
bool IsCausal { get; set; }
bool ReturnAttentionWeights { get; set; }
bool UseFlashAttention2 { get; set; }
double? DropoutRate { get; set; }
double? Scale { get; set; }
double? ScaleFactor { get; set; }
int QueryOffset { get; set; }
int? BlockSize { get; set; }
int? BlockSizeKV { get; set; }
int? BlockSizeQ { get; set; }