TokenLogProb

Models & Types · AiDotNet.Serving.ContinuousBatching

A single (token id, log-probability) pair, used to report the log-probabilities of candidate tokens at a decode position (OpenAI logprobs / top_logprobs).

Constructors

Constructor Summary
TokenLogProb()

Properties

Property Summary
float LogProb { get; set; } The natural-log probability of this token under the (temperature-scaled) model distribution.
int TokenId { get; set; } The vocabulary token id.