GPT2Small

class opennmt.models.GPT2Small(*args, **kwargs)

GPT-2 language model (small version) as described in:

https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf

Inherits from: opennmt.models.LanguageModel

auto_config(num_replicas=1)

Returns automatic configuration values specific to this model.

Parameters

num_replicas – The number of synchronous model replicas used for the training.

Returns

A partial training configuration.