GenerationStepResult

class ctranslate2.GenerationStepResult

The result for a single generation step.

Inherits from: pybind11_builtins.pybind11_object

Attributes:

• batch_id

• hypothesis_id

• is_last

• log_prob

• logits

• step

• token

• token_id

property batch_id

The batch index.

property hypothesis_id

Index of the hypothesis in the batch.

property is_last

Whether this step is the last decoding step for this batch.

property log_prob

Log probability of the token (None if return_log_prob was disabled).

property logits

Log probability on the vocab of all tokens.

property step

The decoding step.

property token

String value of the generated token.

property token_id

ID of the generated token.