WatermarkedIncrementalCausalLanguageModel<T>

Models & Types · AiDotNet.Safety.Watermarking

The incremental (KV-cached) form of WatermarkedCausalLanguageModel: it tracks the context the inner model has seen, so each appended token’s logits are biased for the right green list.

Inheritance: WatermarkedCausalLanguageModel<T> → WatermarkedIncrementalCausalLanguageModel<T>

Implements: IIncrementalCausalLanguageModel<T>

For Beginners

The tracked context starts at StartSequence and grows with every AppendToken; it is not shared between threads, matching the inner model’s own cache. For Beginners: this keeps a fast, cached model fast while still watermarking it.

Constructors

Constructor Summary
WatermarkedIncrementalCausalLanguageModel(IIncrementalCausalLanguageModel<T> inner, IGenerationWatermarker<T> watermarker) Wraps inner with watermarker’s logit bias.

Methods

Method Summary
Vector<T> AppendToken(int tokenId)
Vector<T> StartSequence(IReadOnlyList<int> promptTokenIds)
void ResetCache()