DistilledT5TextConditioner<T>

Models & Types · AiDotNet.Diffusion.Conditioning

Distilled T5 text encoder conditioning module — same architecture as T5 but half the layer count, per the DistilBERT-style knowledge-distillation recipe (Sanh et al., 2019).

Inheritance: NeuralNetworkBase<T> → TextConditioningBase<T> → DistilledT5TextConditioner<T>

Constructors

Constructor Summary
DistilledT5TextConditioner(ITokenizer tokenizer, NeuralNetworkArchitecture<T> architecture, DistilledT5TextConditionerOptions options)

Properties

Property Summary
bool ProducesPooledOutput { get; }

Methods

Method Summary
DistilledT5TextConditioner<T> FromPretrained(DistilledT5Variant variant, string huggingFaceModelName, string cacheDir) Loads a paper-canonical DistilledT5 conditioner with its real pretrained tokenizer (shares the T5 SentencePiece vocab from google/t5-v1_1-base).