tf.contrib.kfac.fisher_factors.DiagonalFactor

Class DiagonalFactor

Inherits From: FisherFactor

Defined in tensorflow/contrib/kfac/python/ops/fisher_factors.py.

A base class for FisherFactors that use diagonal approximations.

A DiagonalFactor's covariance variable can be of any shape, but must contain exactly one entry per parameter.

Properties

name

Methods

__init__

__init__()

Initialize self. See help(type(self)) for accurate signature.

get_cholesky

get_cholesky(damping_func)

get_cholesky_inverse

get_cholesky_inverse(damping_func)

get_cov

get_cov()

get_cov_as_linear_operator

get_cov_as_linear_operator()

get_matpower

get_matpower(
    exp,
    damping_func
)

instantiate_cov_variables

instantiate_cov_variables()

Makes the internal cov variable(s).

instantiate_inv_variables

instantiate_inv_variables()

Makes the internal "inverse" variable(s).

make_covariance_update_op

make_covariance_update_op(ema_decay)

Constructs and returns the covariance update Op.

Args:

  • ema_decay: The exponential moving average decay (float or Tensor).

Returns:

An Op for updating the covariance Variable referenced by _cov.

make_inverse_update_ops

make_inverse_update_ops()

Create and return update ops corresponding to registered computations.

register_cholesky

register_cholesky(damping_func)

register_cholesky_inverse

register_cholesky_inverse(damping_func)

register_matpower

register_matpower(
    exp,
    damping_func
)