TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines

When you’re ready to move your models from research to production, use TFX to create and manage a production pipeline.

See tutorials

Tutorials show you how to use TFX with complete, end-to-end examples.

See the guide

Guides explain the concepts and components of TFX.

How it works

When you’re ready to go beyond training a single model, or ready to put your amazing model to work and move it to production, TFX is there to help you build a complete ML pipeline.

A TFX pipeline is a sequence of components that implement an ML pipeline which is specifically designed for scalable, high-performance machine learning tasks. That includes modeling, training, serving inference, and managing deployments to online, native mobile, and JavaScript targets. To learn more, read our TFX User Guide.

The pipeline components are built using TFX libraries which can also be used individually. Below is an overview of those underlying libraries.

TensorFlow Data Validation

TensorFlow Data Validation (TFDV) helps developers understand, validate, and monitor their ML data at scale. TFDV is used to analyze and validate petabytes of data at Google every day, and has a proven track record in helping TFX users maintain the health of their ML pipelines.

TensorFlow Transform

When applying machine learning to real world datasets, a lot of effort is required to preprocess data into a suitable format. This includes converting between formats, tokenizing and stemming text and forming vocabularies, and performing a variety of numerical operations such as normalization. You can do it all with tf.Transform.

TensorFlow Model Analysis

TensorFlow Model Analysis (TFMA) enables developers to compute and visualize evaluation metrics for their models. Before deploying any machine learning (ML) model, ML developers need to evaluate model performance to ensure that it meets specific quality thresholds and behaves as expected for all relevant slices of data. For example, a model may have an acceptable AUC over the entire eval dataset, but underperform on specific slices. TFMA gives developers the tools to create a deep understanding of their model performance.

TensorFlow Serving

Machine Learning (ML) serving systems need to support model versioning (for model updates with a rollback option) and multiple models (for experimentation via A/B testing), while ensuring that concurrent models achieve high throughput on hardware accelerators (GPUs and TPUs) with low latency. TensorFlow Serving has proven performance handling tens of millions of inferences per second at Google.

Solutions to common problems

Explore step-by-step tutorials to help you with your projects.

Intermediate
Preprocessing data with TensorFlow Transform

In this example we'll be processing a widely used dataset containing census data, and training a model to do classification. Along the way we'll be transforming the data using tf.Transform.

Intermediate
Train and serve a TensorFlow model with TensorFlow Serving

This guide trains a neural network model to classify images of clothing, like sneakers and shirts, saves the trained model, and then serves it with TensorFlow Serving. The focus is on TensorFlow Serving, rather than the modeling and training in TensorFlow.

Intermediate
Data Wrangling with TensorFlow Data Validation

This example colab notebook illustrates how TensorFlow Data Validation (TFDV) can be used to investigate and visualize your dataset. That includes looking at descriptive statistics, inferring a schema, checking for and fixing anomalies, and checking for drift and skew in our dataset.

News & announcements
Sep 10, 2018 
Introducing TensorFlow Data Validation: Data Understanding, Validation, and Monitoring At Scale

Read how TensorFlow Data Validation (TFDV) helps developers understand, validate, and monitor their ML data at scale.

Feb 22, 2017 
Preprocessing for Machine Learning with tf.Transform

Read how tf.Transform helps developers convert between formats, tokenize and stem text, form vocabularies, perform a variety of numerical operations, and more.

Mar 30, 2018 
Introducing TensorFlow Model Analysis: Scaleable, Sliced, and Full-Pass Metrics

Read how TensorFlow Model Analysis (TFMA) combines the power of TensorFlow and Apache Beam to compute and visualize evaluation metrics.

Nov 2, 2017 
Latest Innovations in TensorFlow Serving

Read how TensorFlow Serving supports model versioning and multiple models while ensuring that concurrent models achieve high throughput and low latency.