GenerationResult<T>

Models & Types · AiDotNet.Serving.ContinuousBatching

Result of a generation request.

Constructors

Constructor Summary
GenerationResult()

Properties

Property Summary
List<PositionLogProbs> LogProbs { get; set; } Per-generated-token log-probability records, present only when the request set IncludeLogProbs.
List<int> GeneratedTokens { get; set; } Only the generated tokens (excluding prompt).
List<int> TokenIds { get; set; } All token IDs including prompt.
StopReason FinishReason { get; set; } Reason why generation stopped.
TimeSpan QueueTime { get; set; } Time spent waiting in queue.
TimeSpan? GenerationTime { get; set; } Time spent generating.
double? TokensPerSecond { get; set; } Generation speed.
int GeneratedLength { get; set; } Number of tokens generated.
long SequenceId { get; set; } Unique ID of the sequence.
string Error { get; set; } A human-readable error message when FinishReason is Error (e.g.