Official TFX ImportExampleGen component.
tfx.v1.components.ImportExampleGen(
input_base: Optional[str] = None,
input_config: Optional[Union[tfx.v1.proto.Input
, tfx.v1.dsl.experimental.RuntimeParameter
]] = None,
output_config: Optional[Union[tfx.v1.proto.Output
, tfx.v1.dsl.experimental.RuntimeParameter
]] = None,
range_config: Optional[Union[tfx.v1.proto.RangeConfig
, tfx.v1.dsl.experimental.RuntimeParameter
]] = None,
payload_format: Optional[int] = example_gen_pb2.FORMAT_TF_EXAMPLE
)
The ImportExampleGen component takes TFRecord files with TF Example data format, and generates train and eval examples for downstream components. This component provides consistent and configurable partition, and it also shuffle the dataset for ML best practice.
Component outputs
contains:
examples
: Channel of typestandard_artifacts.Examples
for output train and eval examples.
Attributes | |
---|---|
outputs
|
Component's output channel dict. |
Methods
with_beam_pipeline_args
with_beam_pipeline_args(
beam_pipeline_args: Iterable[Union[str, placeholder.Placeholder]]
) -> 'BaseBeamComponent'
Add per component Beam pipeline args.
Args | |
---|---|
beam_pipeline_args
|
List of Beam pipeline args to be added to the Beam executor spec. |
Returns | |
---|---|
the same component itself. |