FusedBatchNormGrad

public final class FusedBatchNormGrad

Gradient for batch normalization.

Note that the size of 4D Tensors are defined by either "NHWC" or "NCHW". The size of 1D Tensors matches the dimension C of the 4D Tensors.

Nested Classes

class FusedBatchNormGrad.Options Optional attributes for FusedBatchNormGrad  

Constants

String OP_NAME The name of this op, as known by TensorFlow core engine

Public Methods

static <T extends TNumber, U extends TNumber> FusedBatchNormGrad<T, U>
create(Scope scope, Operand<T> yBackprop, Operand<T> x, Operand<TFloat32> scale, Operand<U> reserveSpace1, Operand<U> reserveSpace2, Operand<U> reserveSpace3, Options... options)
Factory method to create a class wrapping a new FusedBatchNormGrad operation.
static FusedBatchNormGrad.Options
dataFormat(String dataFormat)
static FusedBatchNormGrad.Options
epsilon(Float epsilon)
static FusedBatchNormGrad.Options
isTraining(Boolean isTraining)
Output<U>
offsetBackprop()
A 1D Tensor for the gradient with respect to offset.
Output<U>
reserveSpace4()
Unused placeholder to match the mean input in FusedBatchNorm.
Output<U>
reserveSpace5()
Unused placeholder to match the variance input in FusedBatchNorm.
Output<U>
scaleBackprop()
A 1D Tensor for the gradient with respect to scale.
Output<T>
xBackprop()
A 4D Tensor for the gradient with respect to x.

Inherited Methods

Constants

public static final String OP_NAME

The name of this op, as known by TensorFlow core engine

Constant Value: "FusedBatchNormGradV3"

Public Methods

public static FusedBatchNormGrad<T, U> create (Scope scope, Operand<T> yBackprop, Operand<T> x, Operand<TFloat32> scale, Operand<U> reserveSpace1, Operand<U> reserveSpace2, Operand<U> reserveSpace3, Options... options)

Factory method to create a class wrapping a new FusedBatchNormGrad operation.

Parameters
scope current scope
yBackprop A 4D Tensor for the gradient with respect to y.
x A 4D Tensor for input data.
scale A 1D Tensor for scaling factor, to scale the normalized x.
reserveSpace1 When is_training is True, a 1D Tensor for the computed batch mean to be reused in gradient computation. When is_training is False, a 1D Tensor for the population mean to be reused in both 1st and 2nd order gradient computation.
reserveSpace2 When is_training is True, a 1D Tensor for the computed batch variance (inverted variance in the cuDNN case) to be reused in gradient computation. When is_training is False, a 1D Tensor for the population variance to be reused in both 1st and 2nd order gradient computation.
reserveSpace3 When is_training is True, a 1D Tensor for some intermediate results to be reused in gradient computation. When is_training is False, a dummy empty Tensor will be created.
options carries optional attributes values
Returns
  • a new instance of FusedBatchNormGrad

public static FusedBatchNormGrad.Options dataFormat (String dataFormat)

Parameters
dataFormat The data format for y_backprop, x, x_backprop. Either "NHWC" (default) or "NCHW".

public static FusedBatchNormGrad.Options epsilon (Float epsilon)

Parameters
epsilon A small float number added to the variance of x.

public static FusedBatchNormGrad.Options isTraining (Boolean isTraining)

Parameters
isTraining A bool value to indicate the operation is for training (default) or inference.

public Output<U> offsetBackprop ()

A 1D Tensor for the gradient with respect to offset.

public Output<U> reserveSpace4 ()

Unused placeholder to match the mean input in FusedBatchNorm.

public Output<U> reserveSpace5 ()

Unused placeholder to match the variance input in FusedBatchNorm.

public Output<U> scaleBackprop ()

A 1D Tensor for the gradient with respect to scale.

public Output<T> xBackprop ()

A 4D Tensor for the gradient with respect to x.