tfdv.TransformStatsGenerator

View source on GitHub

Generate statistics using a Beam PTransform.

tfdv.TransformStatsGenerator(
    name: Text,
    ptransform: beam.PTransform,
    schema: Optional[schema_pb2.Schema] = None
) -> None

Note that the input PTransform must take a PCollection of sliced examples (tuple of (slice_key, example)) as input and output a PCollection of sliced protos (tuple of (slice_key, DatasetFeatureStatistics proto)).

name A unique name associated with the statistics generator.
schema An optional schema for the dataset.

name

ptransform

schema