PositionLogProbs

Models & Types · AiDotNet.Serving.ContinuousBatching

Log-probability information for one generated position: the chosen token’s log-probability plus, when requested, the top-N most likely alternatives at that step.

Constructors

Constructor Summary
PositionLogProbs()

Properties

Property Summary
List<TokenLogProb> TopLogProbs { get; set; } The most likely tokens at this position (highest log-prob first), including the chosen token.
float LogProb { get; set; } The natural-log probability of the emitted token.
int TokenId { get; set; } The token id that was actually emitted at this position.