WatermarkedIncrementalCausalLanguageModel<T>
Models & Types · AiDotNet.Safety.Watermarking
The incremental (KV-cached) form of WatermarkedCausalLanguageModel: it tracks the context the
inner model has seen, so each appended token’s logits are biased for the right green list.
Inheritance: WatermarkedCausalLanguageModel<T> → WatermarkedIncrementalCausalLanguageModel<T>
Implements: IIncrementalCausalLanguageModel<T>
For Beginners
The tracked context starts at StartSequence and grows with every AppendToken; it is not
shared between threads, matching the inner model’s own cache. For Beginners: this keeps a fast, cached model
fast while still watermarking it.
Constructors
| Constructor | Summary |
|---|---|
WatermarkedIncrementalCausalLanguageModel(IIncrementalCausalLanguageModel<T> inner, IGenerationWatermarker<T> watermarker) |
Wraps inner with watermarker’s logit bias. |
Methods
| Method | Summary |
|---|---|
Vector<T> AppendToken(int tokenId) |
|
Vector<T> StartSequence(IReadOnlyList<int> promptTokenIds) |
|
void ResetCache() |