Missed TensorFlow Dev Summit? Check out the video playlist. Watch recordings

tfp.experimental.nn.initializers.he_uniform

View source on GitHub

He uniform variance scaling initializer.

tfp.experimental.nn.initializers.he_uniform(
    seed=None
)

It draws samples from a uniform distribution within [-limit, limit] where limit is sqrt(6 / fan_in) where fan_in is the number of input units in the weight tensor.

Args:

  • seed: A Python integer. Used to create random seeds. Default value: None.

Returns:

  • init_fn: A python callable which takes a shape Tensor, dtype and an optional scalar int number of batch dims and returns a randomly initialized Tensor with the specified shape and dtype.

References:

He et al., 2015 (pdf)