|View source on GitHub|
Compute Brier score for a probabilistic prediction.
tfp.stats.brier_score( labels, logits, name=None )
The [Brier score] is a loss function for probabilistic predictions over a
number of discrete outcomes. For a probability vector
p and a realized
k the Brier score is
sum_i p[i]*p[i] - 2*p[k]. Smaller values are
better in terms of prediction quality. The Brier score can be negative.
Compared to the cross entropy (aka logarithmic scoring rule) the Brier score does not strongly penalize events which are deemed unlikely but do occur, see . The Brier score is a strictly proper scoring rule and therefore yields consistent probabilistic predictions.
: G.W. Brier. Verification of forecasts expressed in terms of probability. Monthley Weather Review, 1950. : Tilmann Gneiting, Adrian E. Raftery. Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the American Statistical Association, Vol. 102, 2007. https://www.stat.washington.edu/raftery/Research/PDF/Gneiting2007jasa.pdf
labels: Tensor, (N1, ..., Nk), with tf.int32 or tf.int64 elements containing ground truth class labels in the range [0, num_classes].
logits: Tensor, (N1, ..., Nk, num_classes), with logits for each example.
strname prefixed to Ops created by this function.
brier_score: Tensor, (N1, ..., Nk), containint elementwise Brier scores; caller should
reduce_mean()over examples in a dataset.