|View source on GitHub|
Task generator for executing a sync pipeline.
tfx.orchestration.metadata.Metadata, pipeline: pipeline_pb2.Pipeline, is_task_id_tracked_fn: Callable[[task_lib.TaskId], bool] )
generate is not thread-safe. Concurrent calls to
be explicitly serialized. Since MLMD may be updated upon call to
it's also not safe to call
generate on different instances of this class
where the instances refer to the same MLMD db and the same pipeline IR.
||ML metadata db connection.|
||A pipeline IR proto.|
A callable that returns
generate() -> List[
Generates tasks for executing the next executable nodes in the pipeline.
The returned tasks must have
exec_task populated. List may be empty if
no nodes are ready for execution.