tfx.orchestration.component_launcher.BaseComponentLauncher

View source on GitHub

Class BaseComponentLauncher

Responsible for launching driver, executor and publisher of component.

__init__

View source

__init__(
    component_info,
    driver_class,
    component_executor_spec,
    input_dict,
    output_dict,
    exec_properties,
    pipeline_info,
    driver_args,
    metadata_connection_config,
    additional_pipeline_args
)

Initialize a ComponentLauncher.

Args:

  • component_info: ComponentInfo of the component.
  • driver_class: The driver class to run for this component.
  • component_executor_spec: The executor spec to specify what to execute when launching this component.
  • input_dict: Dictionary of input artifacts consumed by this component.
  • output_dict: Dictionary of output artifacts produced by this component.
  • exec_properties: Dictionary of execution properties.
  • pipeline_info: An instance of data_types.PipelineInfo that holds pipeline properties.
  • driver_args: An instance of data_types.DriverArgs that holds component specific driver args.
  • metadata_connection_config: ML metadata connection config.
  • additional_pipeline_args: Additional pipeline args, includes,
    • beam_pipeline_args: Beam pipeline args for beam jobs within executor. Executor will use beam DirectRunner as Default.

Methods

launch

View source

launch()

Execute the component, includes driver, executor and publisher.

Returns:

The execution id of the launch.