Qwen2TextConditioner<T>

Models & Types · AiDotNet.Diffusion.Conditioning

Qwen2 text encoder conditioning module (Yang et al. 2024). Pre-LN RMSNorm Transformer stack with RoPE grouped-query attention and SiLU FFN. Used in multilingual diffusion pipelines for stronger Asian- language prompt understanding.

Inheritance: NeuralNetworkBase<T> → TextConditioningBase<T> → Qwen2TextConditioner<T>

Constructors

Constructor Summary
Qwen2TextConditioner(ITokenizer tokenizer, NeuralNetworkArchitecture<T> architecture, Qwen2TextConditionerOptions options)

Properties

Property Summary
bool ProducesPooledOutput { get; }

Methods

Method Summary
Qwen2TextConditioner<T> FromPretrained(Qwen2Variant variant, string huggingFaceModelName, string cacheDir) Loads a paper-canonical Qwen2 conditioner with its real pretrained BPE tokenizer from HuggingFace.
Tensor<T> GetPooledEmbedding(Tensor<T> sequenceEmbeddings)