Missed TensorFlow Dev Summit? Check out the video playlist. Watch recordings

Module: tfa.optimizers.lamb

View source on GitHub

Layer-wise Adaptive Moments (LAMB) optimizer.

See paper Large Batch Optimization for Deep Learning: Training BERT in 76 minutes.

Classes

class LAMB: Optimizer that implements the Layer-wise Adaptive Moments (LAMB).