NeuralNetworkCausalLanguageModel<T>

Models & Types · AiDotNet.Agentic.Models.Local

Adapts a trained AiDotNet NeuralNetworkBase language model (e.g., MambaLanguageModel, GLALanguageModel, or a Transformer LM head) to the IIncrementalCausalLanguageModel and ILanguageModel seams, enabling KV-cached incremental generation as well as full-context forward passes.

Implements: IDisposable, IIncrementalCausalLanguageModel<T>, ILanguageModel<T>

Constructors

Constructor Summary
NeuralNetworkCausalLanguageModel(NeuralNetworkBase<T> network, int vocabularySize, int? maxContextTokens) Initializes a new adapter over a network language model.

Properties

Property Summary
int VocabularySize { get; }

Methods

Method Summary
Tensor<T> ForwardLogits(Tensor<T> tokenIds)
Vector<T> AppendToken(int tokenId)
Vector<T> NextTokenLogits(IReadOnlyList<int> tokenIds)
Vector<T> StartSequence(IReadOnlyList<int> promptTokenIds)
void Dispose()
void ResetCache()