TokenGeneratedEventArgs<T>

Models & Types ยท AiDotNet.Serving.ContinuousBatching

Event args for token generation.

Inheritance: EventArgs โ†’ TokenGeneratedEventArgs<T>

Constructors

Constructor Summary
TokenGeneratedEventArgs()

Properties

Property Summary
SequenceState<T> Sequence { get; set; } The sequence that generated the token.
int TokenId { get; set; } The generated token ID.