# Module: tf.tpu

<br />

|---|
| [![](https://www.tensorflow.org/images/tf_logo_32px.png) TensorFlow 2 version](https://www.tensorflow.org/api_docs/python/tf/tpu) |

Ops related to Tensor Processing Units.

## Modules

[`experimental`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/experimental) module: Public API for tf.tpu.experimental namespace.

## Classes

[`class CrossShardOptimizer`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/CrossShardOptimizer): An optimizer that averages gradients across TPU shards.

## Functions

[`batch_parallel(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/batch_parallel): Shards `computation` along the batch dimension for parallel execution.

[`bfloat16_scope(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/bfloat16_scope): Scope class for bfloat16 variables so that the model uses custom getter.

[`core(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/core): Returns the device name for a core in a replicated TPU computation.

[`cross_replica_sum(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/cross_replica_sum): Sum the input tensor across replicas according to group_assignment.

[`initialize_system(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/initialize_system): Initializes a distributed TPU system for use with TensorFlow.

[`outside_compilation(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/outside_compilation): Builds part of a computation outside any current TPU replicate scope.

[`replicate(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/replicate): Builds a graph operator that runs a replicated TPU computation.

[`rewrite(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/rewrite): Rewrites `computation` for execution on a TPU system.

[`shard(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/shard): Shards `computation` for parallel execution.

[`shutdown_system(...)`](https://www.tensorflow.org/versions/r1.15/api_docs/python/tf/tpu/shutdown_system): Shuts down a running a distributed TPU system.