GitHub

tfdv.generate_statistics_from_dataframe

Compute data statistics for the input pandas DataFrame.

tfdv.generate_statistics_from_dataframe(
    dataframe: DataFrame,
    stats_options: tfdv.StatsOptions = options.StatsOptions(),
    n_jobs: int = 1
) -> statistics_pb2.DatasetFeatureStatisticsList

This is a utility function for users with in-memory data represented as a pandas DataFrame.

This function supports only DataFrames with columns of primitive types. DataFrames with multivalent features are not supported.

Args
`dataframe`	Input pandas DataFrame.
`stats_options`	`tfdv.StatsOptions` for generating data statistics.
`n_jobs`	Number of processes to run (defaults to 1). If -1 is provided, uses the same number of processes as the number of CPU cores.

Returns
A DatasetFeatureStatisticsList proto.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2022-05-20 UTC.

tfdv.generate_statistics_from_dataframe

Args

Returns