NeuralNetworkCausalLanguageModel<T>
Models & Types · AiDotNet.Agentic.Models.Local
Adapts a trained AiDotNet NeuralNetworkBase language model (e.g.,
MambaLanguageModel, GLALanguageModel, or a Transformer LM head) to the
IIncrementalCausalLanguageModel and ILanguageModel seams,
enabling KV-cached incremental generation as well as full-context forward passes.
Implements: IDisposable, IIncrementalCausalLanguageModel<T>, ILanguageModel<T>
Constructors
| Constructor | Summary |
|---|---|
NeuralNetworkCausalLanguageModel(NeuralNetworkBase<T> network, int vocabularySize, int? maxContextTokens) |
Initializes a new adapter over a network language model. |
Properties
| Property | Summary |
|---|---|
int VocabularySize { get; } |
Methods
| Method | Summary |
|---|---|
Tensor<T> ForwardLogits(Tensor<T> tokenIds) |
|
Vector<T> AppendToken(int tokenId) |
|
Vector<T> NextTokenLogits(IReadOnlyList<int> tokenIds) |
|
Vector<T> StartSequence(IReadOnlyList<int> promptTokenIds) |
|
void Dispose() |
|
void ResetCache() |