tfa.activations.lisht

View source on GitHub

LiSHT: Non-Parameteric Linearly Scaled Hyperbolic Tangent Activation Function.

tfa.activations.lisht(x)

Computes linearly scaled hyperbolic tangent (LiSHT): x * tanh(x)

See LiSHT: Non-Parameteric Linearly Scaled Hyperbolic Tangent Activation Function for Neural Networks.

Args:

  • x: A Tensor. Must be one of the following types: float16, float32, float64.

Returns:

A Tensor. Has the same type as x.