# AllToAll

public final class **AllToAll** An Op to exchange data across TPU replicas.


On each replica, the input is split into \`split_count\` blocks along
\`split_dimension\` and send to the other replicas given group_assignment. After
receiving \`split_count\` - 1 blocks from other replicas, we concatenate the
blocks along \`concat_dimension\` as the output.


For example, suppose there are 2 TPU replicas:
replica 0 receives input: \`\[\[A, B\]\]\`
replica 1 receives input: \`\[\[C, D\]\]\`


group_assignment=\`\[\[0, 1\]\]\`
concat_dimension=0
split_dimension=1
split_count=2


replica 0's output: \`\[\[A\], \[C\]\]\`
replica 1's output: \`\[\[B\], \[D\]\]\`

<br />

<br />

<br />

<br />

### Public Methods

|---|---|
| [Output](https://www.tensorflow.org/api_docs/java/org/tensorflow/Output)\<T\> | [asOutput](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/core/AllToAll#asOutput())() Returns the symbolic handle of a tensor. |
| static \<T\> [AllToAll](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/core/AllToAll)\<T\> | [create](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/core/AllToAll#create(org.tensorflow.op.Scope,%20org.tensorflow.Operand<T>,%20org.tensorflow.Operand<java.lang.Integer>,%20java.lang.Long,%20java.lang.Long,%20java.lang.Long))([Scope](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/Scope) scope, [Operand](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operand)\<T\> input, [Operand](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operand)\<Integer\> groupAssignment, Long concatDimension, Long splitDimension, Long splitCount) Factory method to create a class wrapping a new AllToAll operation. |
| [Output](https://www.tensorflow.org/api_docs/java/org/tensorflow/Output)\<T\> | [output](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/core/AllToAll#output())() The exchanged result. |

### Inherited Methods

From class [org.tensorflow.op.PrimitiveOp](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/PrimitiveOp)

|---|---|
| final boolean | [equals](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/PrimitiveOp#equals(java.lang.Object))(Object obj) |
| final int | [hashCode](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/PrimitiveOp#hashCode())() |
| [Operation](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operation) | [op](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/PrimitiveOp#op())() Returns the underlying `https://www.tensorflow.org/api_docs/java/org/tensorflow/Operation` |
| final String | [toString](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/PrimitiveOp#toString())() |

From class java.lang.Object

|---|---|
| boolean | equals(Object arg0) |
| final Class\<?\> | getClass() |
| int | hashCode() |
| final void | notify() |
| final void | notifyAll() |
| String | toString() |
| final void | wait(long arg0, int arg1) |
| final void | wait(long arg0) |
| final void | wait() |

From interface [org.tensorflow.Operand](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operand)

|---|---|
| abstract [Output](https://www.tensorflow.org/api_docs/java/org/tensorflow/Output)\<T\> | [asOutput](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operand#asOutput())() Returns the symbolic handle of a tensor. |

## Public Methods

#### public [Output](https://www.tensorflow.org/api_docs/java/org/tensorflow/Output)\<T\>
**asOutput**
()

Returns the symbolic handle of a tensor.

Inputs to TensorFlow operations are outputs of another TensorFlow operation. This method is
used to obtain a symbolic handle that represents the computation of the input.

<br />

#### public static [AllToAll](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/core/AllToAll)\<T\>
**create**
([Scope](https://www.tensorflow.org/api_docs/java/org/tensorflow/op/Scope) scope, [Operand](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operand)\<T\> input, [Operand](https://www.tensorflow.org/api_docs/java/org/tensorflow/Operand)\<Integer\> groupAssignment, Long concatDimension, Long splitDimension, Long splitCount)

Factory method to create a class wrapping a new AllToAll operation.

##### Parameters

| scope | current scope |
| input | The local input to the sum. |
| groupAssignment | An int32 tensor with shape \[num_groups, num_replicas_per_group\]. \`group_assignment\[i\]\` represents the replica ids in the ith subgroup. |
| concatDimension | The dimension number to concatenate. |
| splitDimension | The dimension number to split. |
| splitCount | The number of splits, this number must equal to the sub-group size(group_assignment.get_shape()\[1\]) |
|---|---|

##### Returns

- a new instance of AllToAll

#### public [Output](https://www.tensorflow.org/api_docs/java/org/tensorflow/Output)\<T\>
**output**
()

The exchanged result.