Stay organized with collections Save and categorize content based on your preferences.

TensorFlow 2 version View source on GitHub

A LearningRateSchedule that uses a noisy linear cosine decay schedule.

Inherits From: LearningRateSchedule

initial_learning_rate A scalar float32 or float64 Tensor or a Python number. The initial learning rate.
decay_steps A scalar int32 or int64 Tensor or a Python number. Number of steps to decay over.
initial_variance initial variance for the noise. See computation above.
variance_decay decay for the noise's variance. See computation above.
num_periods Number of periods in the cosine part of the decay. See computation above.
alpha See computation above.
beta See computation above.
name String. Optional name of the operation. Defaults to 'NoisyLinearCosineDecay'.



View source

Instantiates a LearningRateSchedule from its config.

config Output of get_config().

A LearningRateSchedule instance.


View source


View source

Call self as a function.