Save the date! Google I/O returns May 18-20 Register now

tf.config.experimental.get_memory_usage

Get the memory usage, in bytes, for the chosen device.

See https://www.tensorflow.org/api_docs/python/tf/device for specifying device strings.

For example:

gpu_devices = tf.config.list_physical_devices('GPU')
if gpu_devices:
  tf.config.experimental.get_memory_usage('GPU:0')

Does not work for CPU.

device Device string to get the bytes in use for.

Total memory usage in bytes.

ValueError Non-existent or CPU device specified.