Scorer

class opennmt.utils.Scorer(name)

Scores hypotheses against references.

Inherits from: abc.ABC

Extended by:

• opennmt.utils.BLEUScorer

• opennmt.utils.PRFScorer

• opennmt.utils.ROUGEScorer

• opennmt.utils.TERScorer

• opennmt.utils.WERScorer

property name

The scorer name.

property scores_name

The names of returned scores.

abstract __call__(ref_path, hyp_path)

Scores hypotheses.

Parameters

• ref_path – Path to the reference.

• hyp_path – Path to the hypotheses.

Returns

The score or dictionary of scores.

lower_is_better()

Returns True if a lower score is better.

higher_is_better()

Returns True if a higher score is better.