<br />

|---|
| [![](https://www.tensorflow.org/images/GitHub-Mark-32px.png) View source on GitHub](https://github.com/tensorflow/models/blob/v2.20.0/official/modeling/optimization/lr_schedule.py) |

Learning rate schedule classes.

## Classes

[`class CosineDecayWithOffset`](https://www.tensorflow.org/api_docs/python/tfm/optimization/CosineDecayWithOffset): A LearningRateSchedule that uses a cosine decay with optional warmup.

[`class DirectPowerDecay`](https://www.tensorflow.org/api_docs/python/tfm/optimization/DirectPowerDecay): Learning rate schedule follows lr \* (step)\^power.

[`class ExponentialDecayWithOffset`](https://www.tensorflow.org/api_docs/python/tfm/optimization/ExponentialDecayWithOffset): A LearningRateSchedule that uses an exponential decay schedule.

[`class LinearWarmup`](https://www.tensorflow.org/api_docs/python/tfm/optimization/LinearWarmup): Linear warmup schedule.

[`class PiecewiseConstantDecayWithOffset`](https://www.tensorflow.org/api_docs/python/tfm/optimization/PiecewiseConstantDecayWithOffset): A LearningRateSchedule that uses a piecewise constant decay schedule.

[`class PolynomialDecayWithOffset`](https://www.tensorflow.org/api_docs/python/tfm/optimization/PolynomialDecayWithOffset): A LearningRateSchedule that uses a polynomial decay schedule.

[`class PolynomialWarmUp`](https://www.tensorflow.org/api_docs/python/tfm/optimization/PolynomialWarmUp): Applies polynomial warmup schedule on a given learning rate decay schedule.

[`class PowerAndLinearDecay`](https://www.tensorflow.org/api_docs/python/tfm/optimization/PowerAndLinearDecay): Learning rate schedule with multiplied by linear decay at the end.

[`class PowerDecayWithOffset`](https://www.tensorflow.org/api_docs/python/tfm/optimization/PowerDecayWithOffset): Power learning rate decay with offset.

[`class StepCosineDecayWithOffset`](https://www.tensorflow.org/api_docs/python/tfm/optimization/StepCosineDecayWithOffset): Stepwise cosine learning rate decay with offset.