KosmosPositionEncoding
Enums · AiDotNet.NeuralNetworks.Layers
How a MagnetoDecoderLayer encodes token positions.
Fields
| Field | Summary |
|---|---|
KosmosPositionEncoding Sinusoidal |
Fairseq sinusoidal absolute positions added to the embeddings (KOSMOS-2 released code). |
KosmosPositionEncoding XPos |
xPos relative positions inside every attention (Sun et al. |
int value__ |