ChatGLM3TextConditioner<T>

Models & Types · AiDotNet.Diffusion.Conditioning

ChatGLM3 text encoder conditioning module (Zeng et al. 2023). Pre-LN RMSNorm Transformer stack with RoPE multi-query attention (KV heads = 1) and SiLU FFN. Used in Kolors and other Chinese-language diffusion pipelines.

Inheritance: NeuralNetworkBase<T> → TextConditioningBase<T> → ChatGLM3TextConditioner<T>

Constructors

Constructor Summary
ChatGLM3TextConditioner(ITokenizer tokenizer, NeuralNetworkArchitecture<T> architecture, ChatGLM3TextConditionerOptions options)

Properties

Property Summary
bool ProducesPooledOutput { get; }

Methods

Method Summary
ChatGLM3TextConditioner<T> FromPretrained(ChatGLM3Variant variant, string huggingFaceModelName, string cacheDir) Loads a paper-canonical ChatGLM3 conditioner with its real pretrained SentencePiece tokenizer from HuggingFace.
Tensor<T> GetPooledEmbedding(Tensor<T> sequenceEmbeddings)