CollectivePermute

public final class CollectivePermute

An Op to permute tensors across replicated TPU instances.

Each instance supplies its own input.

For example, suppose there are 4 TPU instances: `[A, B, C, D]`. Passing source_target_pairs=`[[0,1],[1,2],[2,3],[3,0]]` gets the outputs: `[D, A, B, C]`.

Public Methods

Output <T>
asOutput ()
Returns the symbolic handle of a tensor.
static <T> CollectivePermute <T>
create ( Scope scope, Operand <T> input, Operand <Integer> sourceTargetPairs)
Factory method to create a class wrapping a new CollectivePermute operation.
Output <T>
output ()
The permuted input.

Inherited Methods

Public Methods

public Output <T> asOutput ()

Returns the symbolic handle of a tensor.

Inputs to TensorFlow operations are outputs of another TensorFlow operation. This method is used to obtain a symbolic handle that represents the computation of the input.

public static CollectivePermute <T> create ( Scope scope, Operand <T> input, Operand <Integer> sourceTargetPairs)

Factory method to create a class wrapping a new CollectivePermute operation.

Parameters
scope current scope
input The local input to be permuted. Currently only supports float and bfloat16.
sourceTargetPairs A tensor with shape [num_pairs, 2].
Returns
  • a new instance of CollectivePermute

public Output <T> output ()

The permuted input.