regularization_penalty

opennmt.utils.regularization_penalty(regularization_type, scale, weights)

Computes the weights regularization penalty.

Parameters

• regularization_type – The regularization type: l1, l2, or l1_l2.

• scale – The regularization multiplier. If regularization_type is l1_l2, this should be a list or tuple containing the L1 regularization scale and the L2 regularization scale.

• weights – The list of weights.

Returns

The regularization penalty.

Raises

ValueError – if regularization_type is invalid or is l1_l2 but scale is not a sequence.