Load ADAM embedding parameters with debug support.
An op that loads optimization parameters into HBM for embedding. Must be preceded by a ConfigureTPUEmbeddingHost op that sets up the correct embedding table configuration. For example, this op is used to install parameters that are loaded from a checkpoint before a training loop is executed.
Nested Classes
class | LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
Optional attributes for
LoadTPUEmbeddingADAMParametersGradAccumDebug
|
Public Methods
static LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
config
(String config)
|
static LoadTPUEmbeddingADAMParametersGradAccumDebug | |
static LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
tableId
(Long tableId)
|
static LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
tableName
(String tableName)
|
Inherited Methods
Public Methods
public static LoadTPUEmbeddingADAMParametersGradAccumDebug create ( Scope scope, Operand <Float> parameters, Operand <Float> momenta, Operand <Float> velocities, Operand <Float> gradientAccumulators, Long numShards, Long shardId, Options... options)
Factory method to create a class wrapping a new LoadTPUEmbeddingADAMParametersGradAccumDebug operation.
Parameters
scope | current scope |
---|---|
parameters | Value of parameters used in the ADAM optimization algorithm. |
momenta | Value of momenta used in the ADAM optimization algorithm. |
velocities | Value of velocities used in the ADAM optimization algorithm. |
gradientAccumulators | Value of gradient_accumulators used in the ADAM optimization algorithm. |
options | carries optional attributes values |
Returns
- a new instance of LoadTPUEmbeddingADAMParametersGradAccumDebug