tfx.orchestration.experimental.kubernetes.kubernetes_dag_runner.KubernetesDagRunner

View source on GitHub

TFX runner on Kubernetes.

Inherits From: TfxRunner

tfx.orchestration.experimental.kubernetes.kubernetes_dag_runner.KubernetesDagRunner(
    config: Optional[tfx.orchestration.experimental.kubernetes.kubernetes_dag_runner.KubernetesDagRunnerConfig] = None
)

Args
config	Optional pipeline config for customizing the launching of each component. Defaults to pipeline config that supports InProcessComponentLauncher and KubernetesComponentLauncher.

Methods

run

View source

run(
    pipeline: tfx.orchestration.pipeline.Pipeline
) -> None

Deploys given logical pipeline on Kubernetes.

Args
pipeline	Logical pipeline containing pipeline args and components.