He uniform variance scaling initializer.
tfp.experimental.nn.initializers.he_uniform(
seed=None
)
It draws samples from a uniform distribution within [-limit, limit]
where limit is sqrt(6 / fan_in)
where fan_in is the number of input units in the weight tensor.
Args |
|---|
seed
|
A Python integer. Used to create random seeds.
Default value: None.
|
Returns |
|---|
init_fn
|
A python callable which takes a shape Tensor, dtype and an
optional scalar int number of batch dims and returns a randomly
initialized Tensor with the specified shape and dtype.
|
References:
He et al., 2015
(pdf)
View source on GitHub