ActivationFunctionRole

Enums · AiDotNet.Enums

Defines the functional roles of activation functions in neural networks.

For Beginners

This enum helps organize the different “jobs” that activation functions perform in neural networks, similar to how different workers in a factory have different specialized roles.

How It Works

Different parts of neural networks typically require different activation behaviors. This enum categorizes activation functions by their role rather than by their mathematical form.

Fields

Field Summary
ActivationFunctionRole Attention Used for attention mechanisms.
ActivationFunctionRole Cell Used for memory cell state updates.
ActivationFunctionRole Gate Used for gate mechanisms that control information flow.
ActivationFunctionRole Hidden Used for standard hidden layer activations.
ActivationFunctionRole Normalization Used for normalization functions.
ActivationFunctionRole Output Used for output layer activations.
ActivationFunctionRole Probability Used for probability distributions.
int value__