tf.contrib.all_reduce.build_nccl_all_reduce

tf.contrib.all_reduce.build_nccl_all_reduce(
    input_tensors,
    red_op,
    un_op=None
)

Defined in tensorflow/contrib/all_reduce/python/all_reduce.py.

Build a subgraph that does one full all-reduce, using NCCL.

Args:

  • input_tensors: list of T tf.Tensor of same-shape and type values to be reduced.
  • red_op: binary elementwise reduction operator. Must be one of {tf.add}
  • un_op: optional unary elementwise Op to apply to fully-reduce values.

Returns:

list of T tf.Tensor of reduced values.

Raises:

  • ValueError: red_op not supported.