PositionLogProbs
Models & Types · AiDotNet.Serving.ContinuousBatching
Log-probability information for one generated position: the chosen token’s log-probability plus, when requested, the top-N most likely alternatives at that step.
Constructors
| Constructor | Summary |
|---|---|
PositionLogProbs() |
Properties
| Property | Summary |
|---|---|
List<TokenLogProb> TopLogProbs { get; set; } |
The most likely tokens at this position (highest log-prob first), including the chosen token. |
float LogProb { get; set; } |
The natural-log probability of the emitted token. |
int TokenId { get; set; } |
The token id that was actually emitted at this position. |