# tff.learning.optimizers.build_adagrad

<br />

|---|
| [![](https://www.tensorflow.org/images/GitHub-Mark-32px.png) View source on GitHub](https://github.com/tensorflow/federated/blob/v0.87.0 Version 2.0, January 2004 Licensed under the Apache License, Version 2.0 (the) |

Returns a [`tff.learning.optimizers.Optimizer`](https://www.tensorflow.org/federated/api_docs/python/tff/learning/optimizers/Optimizer) for Adagrad.

    tff.learning.optimizers.build_adagrad(
        learning_rate: optimizer.Float,
        initial_preconditioner_value: optimizer.Float = 0.1,
        epsilon: optimizer.Float = 1e-07
    ) -> https://www.tensorflow.org/federated/api_docs/python/tff/learning/optimizers/Optimizer

The Adagrad optimizer is based on [Adaptive Subgradient Methods for Online
Learning and Stochastic Optimization](https://www.jmlr.org/papers/volume12/duchi11a/duchi11a.pdf)

The update rule given learning rate `lr`, epsilon `eps`, preconditioner `s`,
weights `w` and gradients `g` is:

    s = s + g**2
    w = w - lr * g / sqrt(s + eps)

<br />

<br />

<br />

| ## Args ||
|---|---|
| `learning_rate` | A positive float for learning rate. |
| `initial_preconditioner_value` | A non-negative float, initial value for the preconditioner. |
| `epsilon` | A small non-negative float, used to maintain numerical stability. |

<br />