T5FeedForwardLayer<T>

Layers ยท AiDotNet.NeuralNetworks.Layers

T5 feed-forward block (DenseReluDense): bias-free wo(relu(wi(x))).

Inheritance: LayerBase<T> โ†’ T5FeedForwardLayer<T>

Implements: IShapeContract

Constructors

Constructor Summary
T5FeedForwardLayer(int dim, int ffDim)

Properties

Property Summary
bool SupportsTraining { get; }

Methods

Method Summary
Dictionary<string, string> GetParameterRoles() Returns parameter roles for per-role optimizer configuration (e.g., weight decay exemption for biases).
IReadOnlyList<OutputAxisContract> OutputAxesFor(int inputRank)
IReadOnlyList<Tensor<T>> GetTrainableParameters() Returns all trainable parameter tensors marked with [TrainableParameter].
void ResetState()
void SetTrainableParameters(IReadOnlyList<Tensor<T>> parameters) Replaces trainable parameter tensors (e.g., with ParameterBuffer views).
void ZeroGrad() Clears all gradient fields discovered by convention ({paramName}Gradient).