Missed TensorFlow World? Check out the recap. Learn more

tf.distribute.experimental.CollectiveCommunication

TensorFlow 1 version View source on GitHub

Class CollectiveCommunication

Communication choices for CollectiveOps.

Aliases:

  • AUTO: Default to runtime's automatic choices.
  • RING: TensorFlow's ring algorithms for all-reduce and all-gather.
  • NCCL: Use ncclAllReduce for all-reduce, and ring algorithms for all-gather.

Class Members

  • AUTO
  • NCCL
  • RING