NcclAllReduce

public final class NcclAllReduce

Outputs a tensor containing the reduction across all input tensors.

Outputs a tensor containing the reduction across all input tensors passed to ops within the same `shared_name.

The graph should be constructed so if one op runs with shared_name value `c`, then `num_devices` ops will run with shared_name value `c`. Failure to do so will cause the graph execution to fail to complete.

input: the input to the reduction data: the value of the reduction across all `num_devices` devices. reduction: the reduction operation to perform. num_devices: The number of devices participating in this reduction. shared_name: Identifier that shared between ops of the same reduction.

Public Methods

Output<T>
asOutput()
Returns the symbolic handle of a tensor.
static <T extends Number> NcclAllReduce<T>
create(Scope scope, Operand<T> input, String reduction, Long numDevices, String sharedName)
Factory method to create a class wrapping a new NcclAllReduce operation.
Output<T>
data()

Inherited Methods

Public Methods

public Output<T> asOutput ()

Returns the symbolic handle of a tensor.

Inputs to TensorFlow operations are outputs of another TensorFlow operation. This method is used to obtain a symbolic handle that represents the computation of the input.

public static NcclAllReduce<T> create (Scope scope, Operand<T> input, String reduction, Long numDevices, String sharedName)

Factory method to create a class wrapping a new NcclAllReduce operation.

Parameters
scope current scope
Returns
  • a new instance of NcclAllReduce

public Output<T> data ()