GenerationResult<T>
Models & Types · AiDotNet.Serving.ContinuousBatching
Result of a generation request.
Constructors
| Constructor | Summary |
|---|---|
GenerationResult() |
Properties
| Property | Summary |
|---|---|
List<PositionLogProbs> LogProbs { get; set; } |
Per-generated-token log-probability records, present only when the request set IncludeLogProbs. |
List<int> GeneratedTokens { get; set; } |
Only the generated tokens (excluding prompt). |
List<int> TokenIds { get; set; } |
All token IDs including prompt. |
StopReason FinishReason { get; set; } |
Reason why generation stopped. |
TimeSpan QueueTime { get; set; } |
Time spent waiting in queue. |
TimeSpan? GenerationTime { get; set; } |
Time spent generating. |
double? TokensPerSecond { get; set; } |
Generation speed. |
int GeneratedLength { get; set; } |
Number of tokens generated. |
long SequenceId { get; set; } |
Unique ID of the sequence. |
string Error { get; set; } |
A human-readable error message when FinishReason is Error (e.g. |