tf.contrib.tpu.cross_replica_sum

tf.contrib.tpu.cross_replica_sum(
    x,
    group_assignment=None,
    name=None
)

Defined in tensorflow/contrib/tpu/python/ops/tpu_ops.py.

Sum the input tensor accorss replicas according to group_assignment.

Args:

  • x: The local tensor to the sum.
  • group_assignment: Optional 2d int32 lists with shape [num_groups, num_replicas_per_group]. group_assignment[i] represents the replica ids in the ith subgroup.
  • name: Optional op name.

Returns:

A Tensor which is summed across replicas.