tfx.components.CsvExampleGen

View source on GitHub

Class CsvExampleGen

Official TFX CsvExampleGen component.

Inherits From: FileBasedExampleGen

Aliases: tfx.components.example_gen.csv_example_gen.component.CsvExampleGen

Used in the tutorials:

The csv examplegen component takes csv data, and generates train and eval examples for downsteam components.

__init__

View source

__init__(
    input=None,
    input_config=None,
    output_config=None,
    example_artifacts=None,
    input_base=None,
    instance_name=None
)

Construct a CsvExampleGen component.

Args:

  • input: A Channel of 'ExternalPath' type, which includes one artifact whose uri is an external directory with csv files inside (required).
  • input_config: An example_gen_pb2.Input instance, providing input configuration. If unset, the files under input_base will be treated as a single split.
  • output_config: An example_gen_pb2.Output instance, providing output configuration. If unset, default splits will be 'train' and 'eval' with size 2:1.
  • example_artifacts: Optional channel of 'ExamplesPath' for output train and eval examples.
  • input_base: Backwards compatibility alias for the 'input' argument.
  • instance_name: Optional unique instance name. Necessary if multiple CsvExampleGen components are declared in the same pipeline.

Child Classes

class DRIVER_CLASS

class SPEC_CLASS

Properties

component_id

DEPRECATED FUNCTION

component_type

DEPRECATED FUNCTION

downstream_nodes

exec_properties

id

Node id, unique across all TFX nodes in a pipeline.

If instance name is available, node_id will be: . otherwise, node_id will be:

Returns:

node id.

inputs

outputs

type

upstream_nodes

Methods

add_downstream_node

View source

add_downstream_node(downstream_node)

add_upstream_node

View source

add_upstream_node(upstream_node)

from_json_dict

View source

from_json_dict(
    cls,
    dict_data
)

Convert from dictionary data to an object.

to_json_dict

View source

to_json_dict()

Convert from an object to a JSON serializable dictionary.

Class Members

  • EXECUTOR_SPEC