Join the SIG TFX-Addons community and help make TFX even better!

tfx.dsl.components.base.base_beam_component.BaseBeamComponent

Base class for a TFX Beam pipeline component.

Inherits From: BaseComponent, BaseNode

An instance of a subclass of BaseBaseComponent represents the parameters for a single execution of that TFX Beam pipeline component.

Beam based components should subclass BaseBeamComponent instead of BaseComponent in order to inherit Beam related SDKs. All subclasses of BaseBeamComponent should override the required class level attributes specified in BaseComponent.

spec types.ComponentSpec object for this component instance.
custom_executor_spec Optional custom executor spec overriding the default executor specified in the component attribute.

outputs Component's output channel dict.

Methods

with_beam_pipeline_args

View source

Add per component Beam pipeline args.

Args
beam_pipeline_args List of Beam pipeline args to be added to the Beam executor spec.

Returns
the same component itself.