tf.keras.layers.SpatialDropout1D

TensorFlow 2 version View source on GitHub

Spatial 1D version of Dropout.

Inherits From: Dropout

tf.keras.layers.SpatialDropout1D(
    rate, **kwargs
)

This version performs the same function as Dropout, however it drops entire 1D feature maps instead of individual elements. If adjacent frames within feature maps are strongly correlated (as is normally the case in early convolution layers) then regular dropout will not regularize the activations and will otherwise just result in an effective learning rate decrease. In this case, SpatialDropout1D will help promote independence between feature maps and should be used instead.

rate Float between 0 and 1. Fraction of the input units to drop.

Call arguments:

  • inputs: A 3D tensor.
  • training: Python boolean indicating whether the layer should behave in training mode (adding dropout) or in inference mode (doing nothing).

Input shape:

3D tensor with shape: (samples, timesteps, channels)

Output shape:

Same as input.

References: