LeCunInitializationStrategy<T>
Models & Types · AiDotNet.Initialization
LeCun initialization strategy for SELU activations and self-normalizing networks.
Inheritance: InitializationStrategyBase<T> → LeCunInitializationStrategy<T>
For Beginners
Use this with SELU activation functions for deep networks that automatically maintain stable activations without batch normalization.
How It Works
LeCun initialization uses variance 1/fan_in, designed for networks with SELU activation that maintain self-normalizing properties through many layers.
Constructors
| Constructor | Summary |
|---|---|
LeCunInitializationStrategy() |
Creates a LeCun initialization strategy with the framework’s default thread-safe RNG. |
LeCunInitializationStrategy(Random rng) |
Creates a LeCun initialization strategy with a caller-supplied Random source. |
Properties
| Property | Summary |
|---|---|
bool IsLazy { get; } |
|
bool LoadFromExternal { get; } |
Methods
| Method | Summary |
|---|---|
void InitializeBiases(Tensor<T> biases) |
|
void InitializeWeights(Tensor<T> weights, int inputSize, int outputSize) |