FlashAttentionConfig
Options & Configuration · AiDotNet.Tensors.Engines.Autodiff
No summary documentation available yet.
Constructors
| Constructor | Summary |
|---|---|
FlashAttentionConfig() |
Properties
| Property | Summary |
|---|---|
FlashAttentionConfig Default { get; } |
|
bool Float32Precision { get; set; } |
|
bool IsCausal { get; set; } |
|
bool ReturnAttentionWeights { get; set; } |
|
bool UseFlashAttention2 { get; set; } |
|
double? DropoutRate { get; set; } |
|
double? Scale { get; set; } |
|
double? ScaleFactor { get; set; } |
|
int QueryOffset { get; set; } |
|
int? BlockSize { get; set; } |
|
int? BlockSizeKV { get; set; } |
|
int? BlockSizeQ { get; set; } |