tfma.metrics.QueryStatistics

Query statistic metrics.

Inherits From: Metric

tfma.metrics.QueryStatistics(
    total_queries_name=TOTAL_QUERIES_NAME,
    total_documents_name=TOTAL_DOCUMENTS_NAME,
    min_documents_name=MIN_DOCUMENTS_NAME, max_documents_name=MAX_DOCUMENTS_NAME
)

These metrics are query/ranking based so a query_key must also be provided in the associated metrics spec.

total_queries_name Total queries metric name.
total_documents_name Total documents metric name.
min_documents_name Min documents name.
max_documents_name Max documents name.

compute_confidence_interval Whether to compute confidence intervals for this metric.

Note that this may not completely remove the computational overhead involved in computing a given metric. This is only respected by the jackknife confidence interval method.

Methods

computations

View source

computations(
    eval_config: Optional[tfma.EvalConfig] = None,
    schema: Optional[schema_pb2.Schema] = None,
    model_names: Optional[List[Text]] = None,
    output_names: Optional[List[Text]] = None,
    sub_keys: Optional[List[Optional[SubKey]]] = None,
    aggregation_type: Optional[AggregationType] = None,
    class_weights: Optional[Dict[int, float]] = None,
    query_key: Optional[Text] = None,
    is_diff: Optional[bool] = False
) -> tfma.metrics.MetricComputations

Creates computations associated with metric.

get_config

View source

get_config() -> tfma.types.Extracts

Returns serializable config.