TF 2.0 is out! Get hands-on practice at TF World, Oct 28-31. Use code TF20 for 20% off select passes. Register now


View source on GitHub

Mutual information estimators and helpers.


lower_bound_barber_agakov(...): Lower bound on mutual information from [Barber and Agakov (2003)][1].

lower_bound_info_nce(...): InfoNCE lower bound on mutual information.

lower_bound_jensen_shannon(...): Lower bound on Jensen-Shannon (JS) divergence.

lower_bound_nguyen_wainwright_jordan(...): Lower bound on Kullback-Leibler (KL) divergence from Nguyen at al.