tf.distribute.experimental.CollectiveCommunication

View source on GitHub

Communication choices for CollectiveOps.

View aliases

Compat aliases for migration

See Migration guide for more details.

tf.compat.v1.distribute.experimental.CollectiveCommunication

AUTO: Default to runtime's automatic choices.
RING: TensorFlow's ring algorithms for all-reduce and all-gather.
NCCL: Use ncclAllReduce for all-reduce, and ring algorithms for all-gather.

Class Variables

AUTO
NCCL
RING

© 2020 The TensorFlow Authors. All rights reserved.
Licensed under the Creative Commons Attribution License 3.0.
Code samples licensed under the Apache 2.0 License.
https://www.tensorflow.org/versions/r2.3/api_docs/python/tf/distribute/experimental/CollectiveCommunication