T5FeedForwardLayer<T>
Layers ยท AiDotNet.NeuralNetworks.Layers
T5 feed-forward block (DenseReluDense): bias-free wo(relu(wi(x))).
Inheritance: LayerBase<T> โ T5FeedForwardLayer<T>
Implements: IShapeContract
Constructors
| Constructor | Summary |
|---|---|
T5FeedForwardLayer(int dim, int ffDim) |
Properties
| Property | Summary |
|---|---|
bool SupportsTraining { get; } |
Methods
| Method | Summary |
|---|---|
Dictionary<string, string> GetParameterRoles() |
Returns parameter roles for per-role optimizer configuration (e.g., weight decay exemption for biases). |
IReadOnlyList<OutputAxisContract> OutputAxesFor(int inputRank) |
|
IReadOnlyList<Tensor<T>> GetTrainableParameters() |
Returns all trainable parameter tensors marked with [TrainableParameter]. |
void ResetState() |
|
void SetTrainableParameters(IReadOnlyList<Tensor<T>> parameters) |
Replaces trainable parameter tensors (e.g., with ParameterBuffer views). |
void ZeroGrad() |
Clears all gradient fields discovered by convention ({paramName}Gradient). |