Stay organized with collections Save and categorize content based on your preferences.

View source on GitHub

A conditional accumulator for aggregating gradients.

Up-to-date gradients (i.e., time step at which gradient was computed is equal to the accumulator's time step) are added to the accumulator.

Extraction of the average gradient is blocked until the required number of gradients has been accumulated.

dtype Datatype of the accumulated gradients.
shape Shape of the accumulated gradients.
accumulator_ref A handle to the conditional accumulator, created by sub- classes

accumulator_ref The underlying accumulator reference.
dtype The datatype of the gradients accumulated by this accumulator.
name The name of the underlying accumulator.



View source

Number of gradients that have currently been aggregated in accumulator.

name Optional name for the operation.

Number of accumulated gradients currently in accumulator.


View source

Sets the global time step of the accumulator.

The operation logs a warning if we attempt to set to a time step that is lower than the accumulator's own time step.

new_global_step Value of new time step. Can be a variable or a constant
name Optional name for the operation.

Operation that sets the accumulator's time step.