TensorFlow is back at Google I/O on May 14! Register now

tfm.utils.activations.simple_swish

Computes the Swish activation function.

tfm.utils.activations.simple_swish(
    features
)

The tf.nn.swish operation uses a custom gradient to reduce memory usage. Since saving custom gradients in SavedModel is currently not supported, and one would not be able to use an exported TF-Hub module for fine-tuning, we provide this wrapper that can allow to select whether to use the native TensorFlow swish operation, or whether to use a customized operation that has uses default TensorFlow gradient computation.

Args
`features`	A `Tensor` representing preactivation values.

Returns
The activation value.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.

Last updated 2024-02-02 UTC.

tfm.utils.activations.simple_swish

Args

Returns