ChatGLM3TextConditioner<T>
Models & Types · AiDotNet.Diffusion.Conditioning
ChatGLM3 text encoder conditioning module (Zeng et al. 2023). Pre-LN RMSNorm Transformer stack with RoPE multi-query attention (KV heads = 1) and SiLU FFN. Used in Kolors and other Chinese-language diffusion pipelines.
Inheritance: NeuralNetworkBase<T> → TextConditioningBase<T> → ChatGLM3TextConditioner<T>
Constructors
| Constructor | Summary |
|---|---|
ChatGLM3TextConditioner(ITokenizer tokenizer, NeuralNetworkArchitecture<T> architecture, ChatGLM3TextConditionerOptions options) |
Properties
| Property | Summary |
|---|---|
bool ProducesPooledOutput { get; } |
Methods
| Method | Summary |
|---|---|
ChatGLM3TextConditioner<T> FromPretrained(ChatGLM3Variant variant, string huggingFaceModelName, string cacheDir) |
Loads a paper-canonical ChatGLM3 conditioner with its real pretrained SentencePiece tokenizer from HuggingFace. |
Tensor<T> GetPooledEmbedding(Tensor<T> sequenceEmbeddings) |