TensorFlow Transform is a library for preprocessing data with TensorFlow.
tf.Transform is useful for data that requires a full-pass, such as:
- Normalizing an input value by mean and standard deviation.
- Convert a vocabulary to integers by looking at all input examples for values.
- Categorize inputs into buckets based on the observed data distribution.
TensorFlow has built-in support for manipulations on a single example or a batch
tf.Transform extends these capabilities to support full-passes
over the example data.
The output of
tf.Transform is exported as a
TensorFlow graph to use for training and serving.
Using the same graph for both training and serving can prevent skew since the
same transformations are applied in both stages.
PyPI package is the
recommended way to install
pip install tensorflow-transform
Apache Beam is required to run distributed analysis.
By default, Apache Beam runs in local mode but can also run in distributed mode
using Google Cloud Dataflow.
tf.Transform is designed to be extensible for other Apache Beam runners.
The following table is the
tf.Transform package versions that are
compatible with each other. This is determined by our testing framework, but
other untested combinations may also work.
|GitHub master||nightly (1.x)||2.4.0|