He uniform variance scaling initializer.
tfp.experimental.nn.initializers.he_uniform(
seed=None
)
It draws samples from a uniform distribution within [-limit, limit]
where limit
is sqrt(6 / fan_in)
where fan_in
is the number of input units in the weight tensor.
Args |
seed
|
A Python integer. Used to create random seeds.
Default value: None .
|
Returns |
init_fn
|
A python callable which takes a shape Tensor , dtype and an
optional scalar int number of batch dims and returns a randomly
initialized Tensor with the specified shape and dtype.
|
References:
He et al., 2015
(pdf)