opennmt.data

This module exposes classes and functions that help creating and processing data.

• Noise
• Vocab
• WordDropout
• WordNoiser
• WordOmission
• WordPermutation
• WordReplacement
• alignment_matrix_from_pharaoh
• batch_dataset
• batch_sequence_dataset
• create_lookup_tables
• filter_examples_by_length
• filter_irregular_batches
• get_dataset_size
• inference_pipeline
• make_cardinality_multiple_of
• random_shard
• shuffle_dataset
• tokens_to_chars
• tokens_to_words
• training_pipeline