The WiML Symposium 2023 returns December 7! Join the livestream at 9:30 AM PST Register

CollectivePermute

public final class CollectivePermute

An Op to permute tensors across replicated TPU instances.

Each instance supplies its own input.

For example, suppose there are 4 TPU instances: `[A, B, C, D]`. Passing source_target_pairs=`[[0,1],[1,2],[2,3],[3,0]]` gets the outputs: `[D, A, B, C]`.

Public Methods

Output<T>	asOutput() Returns the symbolic handle of a tensor.
static <T> CollectivePermute<T>	create(Scope scope, Operand<T> input, Operand<Integer> sourceTargetPairs) Factory method to create a class wrapping a new CollectivePermute operation.
Output<T>	output() The permuted input.

Inherited Methods

From class org.tensorflow.op.PrimitiveOp

final boolean	equals(Object obj)
final int	hashCode()
Operation	op() Returns the underlying `Operation`
final String	toString()

From class java.lang.Object

boolean	equals(Object arg0)
final Class<?>	getClass()
int	hashCode()
final void	notify()
final void	notifyAll()
String	toString()
final void	wait(long arg0, int arg1)
final void	wait(long arg0)
final void	wait()

From interface org.tensorflow.Operand

abstract Output<T>

asOutput()

Returns the symbolic handle of a tensor.

Public Methods

public Output<T> asOutput ()

Returns the symbolic handle of a tensor.

Inputs to TensorFlow operations are outputs of another TensorFlow operation. This method is used to obtain a symbolic handle that represents the computation of the input.

public static CollectivePermute<T> create (Scope scope, Operand<T> input, Operand<Integer> sourceTargetPairs)

Factory method to create a class wrapping a new CollectivePermute operation.

Parameters

scope	current scope
input	The local input to be permuted. Currently only supports float and bfloat16.
sourceTargetPairs	A tensor with shape [num_pairs, 2].

Returns

a new instance of CollectivePermute

public Output<T> output ()

The permuted input.