tf.contrib.mixed_precision.FixedLossScaleManager

Class FixedLossScaleManager

Inherits From: LossScaleManager

Defined in tensorflow/contrib/mixed_precision/python/loss_scale_manager.py.

Loss scale manager with a fixed loss scale.

The loss scale is not updated for the lifetime of the class.

__init__

__init__(loss_scale)

Creates the fixed loss scale manager.

Args:

  • loss_scale: A Python float. Its ideal value varies depending on models to run. Choosing a too small loss_scale might affect model quality; a too big loss_scale might cause inf or nan. There is no single right loss_scale to apply. There is no harm choosing a relatively big number as long as no nan or inf is encountered in training.

Raises:

  • ValueError: If loss_scale is less than 1.

Methods

get_loss_scale

get_loss_scale()

update_loss_scale

update_loss_scale(finite_grads)