tf.contrib.all_reduce.build_nccl_then_recursive_hd

tf.contrib.all_reduce.build_nccl_then_recursive_hd(
    input_tensors,
    red_op,
    un_op=None
)

Defined in tensorflow/contrib/all_reduce/python/all_reduce.py.

Construct hybrid of NCCL within workers, Recursive-HD across workers.