ActivationTask

Enums · AiDotNet.Enums

Tasks or architectural positions where an activation function is commonly used.

Fields

Field Summary
ActivationTask AttentionGating Attention mechanism gating (Softmax over attention scores).
ActivationTask CapsuleSquash Capsule network squashing functions.
ActivationTask GenerativeOutput Generative model outputs (Tanh for image generation [-1,1]).
ActivationTask HiddenLayer Standard hidden layer activation in feedforward/convolutional networks.
ActivationTask NormalizationOutput Producing normalized probability distributions.
ActivationTask OutputLayer Output layer activation for final predictions (classification, regression).
ActivationTask RecurrentGating Recurrent network gating (LSTM/GRU forget/input/output gates).
ActivationTask SpikingNeuron Spiking neural network activations.
ActivationTask TransformerFFN Transformer feed-forward sublayers (GELU, SwiGLU).
int value__