Missed TensorFlow Dev Summit? Check out the video playlist. Watch recordings

tf.nn.swish

TensorFlow 1 version View source on GitHub

Computes the Swish activation function: x * sigmoid(x).

tf.nn.swish(
    features
)

Source: "Searching for Activation Functions" (Ramachandran et al. 2017) arxiv.org/abs/1710.05941

Args:

  • features: A Tensor representing preactivation values.
  • name: A name for the operation (optional).

Returns:

The activation value.