View source on GitHub
|
Initializes scale to alternate between 1 and -1 for each term.
tfl.kronecker_factored_lattice_lib.scale_initializer(
units, num_terms
)
Args | |
|---|---|
units
|
Output dimension of the layer. Each of units scale will be initialized identically. |
num_terms
|
Number of independently trained submodels per unit, the outputs of which are averaged to get the final output. |
Returns | |
|---|---|
Kronecker-Factored Lattice scale of shape: (units, num_terms).
|