CTranslate2Exporter

class opennmt.utils.CTranslate2Exporter(quantization=None)

CTranslate2 exporter.

Inherits from: opennmt.utils.Exporter

Extended by:

• opennmt.utils.CTranslate2Float16Exporter

• opennmt.utils.CTranslate2Int16Exporter

• opennmt.utils.CTranslate2Int8Exporter

• opennmt.utils.CTranslate2Int8Float16Exporter

__init__(quantization=None)

Initializes the exporter.

Parameters

quantization – Quantize model weights to this type when exporting the model. Can be “int8”, “int16”, “float16”, or “int8_float16”. Default is no quantization.

Raises

• ImportError – if the CTranslate2 package is missing.

• ValueError – if quantization is invalid.