tfx.components.infra_validator.serving_bins.TensorFlowServing

View source on GitHub

TensorFlow Serving binary.

Inherits From: ServingBinary

container_port Container port of the model server.

Only applies to docker compatible serving binaries.

image Container image of the model server.

Only applies to docker compatible serving binaries.

Methods

MakeClient

View source

Create a model server client of this serving binary.

MakeDockerRunParams

View source

Make parameters for docker client.containers.run.

Args
model_path A path to the model.
needs_mount If True, model_path will be mounted to the container.

Returns
A dictionary of docker run parameters.

MakeEnvVars

View source

Construct environment variables to be used in container image.

Only applies to docker compatible serving binaries.

Args
*args List of unresolved variables to configure environment variables.

Returns
A dictionary of environment variables inside container.