Module: tfp.vi.mutual_information

Mutual information estimators and helpers.

Functions

lower_bound_barber_agakov(...): Lower bound on mutual information from [Barber and Agakov (2003)][1].

lower_bound_info_nce(...): InfoNCE lower bound on mutual information.

lower_bound_jensen_shannon(...): Lower bound on Jensen-Shannon (JS) divergence.

lower_bound_nguyen_wainwright_jordan(...): Lower bound on Kullback-Leibler (KL) divergence from Nguyen at al.