Registration is open for TensorFlow Dev Summit 2020 Learn more

Module: tfa.optimizers.lamb

View source on GitHub

Layer-wise Adaptive Moments (LAMB) optimizer.

See paper Large Batch Optimization for Deep Learning: Training BERT in 76 minutes.

Classes

class LAMB: Optimizer that implements the Layer-wise Adaptive Moments (LAMB).