The Glorot uniform initializer, aka Xavier uniform initializer.
tfp.experimental.nn.initializers.glorot_uniform(
seed=None
)
It draws samples from a uniform distribution within [-limit, limit]
where limit
is sqrt(6 / (fan_in + fan_out))
where fan_in
is the number of input units in the weight tensor
and fan_out
is the number of output units in the weight tensor.
Returns |
init_fn
|
A python callable which takes a shape Tensor , dtype and an
optional scalar int number of batch dims and returns a randomly
initialized Tensor with the specified shape and dtype.
|