ActivationFunctionRole
Enums · AiDotNet.Enums
Defines the functional roles of activation functions in neural networks.
For Beginners
This enum helps organize the different “jobs” that activation functions perform in neural networks, similar to how different workers in a factory have different specialized roles.
How It Works
Different parts of neural networks typically require different activation behaviors. This enum categorizes activation functions by their role rather than by their mathematical form.
Fields
| Field | Summary |
|---|---|
ActivationFunctionRole Attention |
Used for attention mechanisms. |
ActivationFunctionRole Cell |
Used for memory cell state updates. |
ActivationFunctionRole Gate |
Used for gate mechanisms that control information flow. |
ActivationFunctionRole Hidden |
Used for standard hidden layer activations. |
ActivationFunctionRole Normalization |
Used for normalization functions. |
ActivationFunctionRole Output |
Used for output layer activations. |
ActivationFunctionRole Probability |
Used for probability distributions. |
int value__ |