View source on GitHub

NDCG (normalized discounted cumulative gain) metric.

Inherits From: Metric

Calculates NDCG@k for the given value sub key value for top_k and the value of gain in the 'gain_key' feature. The value of NDCG@k returned is a weighted average of NDCG@k over the set of queries using the example weights.

NDCG@k = (DCG@k for the given rank)/(DCG@k DCG@k = sum_{i=1}^k gain_i/log_2(i+1), where gain_i is the gain (relevance score) of the i^th ranked response, indexed from 1.

This is a query/ranking based metric so a query_key must also be provided in the associated metrics spec.

gain_key Key of feature in features dictionary that holds gain values.
name Metric name.

compute_confidence_interval Whether to compute confidence intervals for this metric.

Note that this may not completely remove the computational overhead involved in computing a given metric. This is only respected by the jackknife confidence interval method.



View source

Creates computations associated with metric.


View source

Returns serializable config.


View source

Returns true if the metric does not depend on a model.