TF 2.0 is out! Get hands-on practice at TF World, Oct 28-31. Use code TF20 for 20% off select passes. Register now

tfx.components.example_gen.big_query_example_gen.component.BigQueryExampleGen

View source on GitHub

Class BigQueryExampleGen

Official TFX BigQueryExampleGen component.

The BigQuery examplegen component takes a query, and generates train and eval examples for downsteam components.

__init__

View source

__init__(
    query=None,
    input_config=None,
    output_config=None,
    example_artifacts=None,
    instance_name=None
)

Constructs a BigQueryExampleGen component.

Args:

  • query: BigQuery sql string, query result will be treated as a single split, can be overwritten by input_config.
  • input_config: An example_gen_pb2.Input instance with Split.pattern as BigQuery sql string. If set, it overwrites the 'query' arg, and allows different queries per split.
  • output_config: An example_gen_pb2.Output instance, providing output configuration. If unset, default splits will be 'train' and 'eval' with size 2:1.
  • example_artifacts: Optional channel of 'ExamplesPath' for output train and eval examples.
  • instance_name: Optional unique instance name. Necessary if multiple BigQueryExampleGen components are declared in the same pipeline.

Raises:

  • RuntimeError: Only one of query and input_config should be set.

Child Classes

class DRIVER_CLASS

class SPEC_CLASS

Properties

component_id

Component id, unique across all component instances in a pipeline.

If unique name is available, component_id will be: . otherwise, component_id will be:

Returns:

component id.

component_type

downstream_nodes

exec_properties

inputs

outputs

upstream_nodes

Methods

add_downstream_node

View source

add_downstream_node(downstream_node)

add_upstream_node

View source

add_upstream_node(upstream_node)

Class Members

  • EXECUTOR_SPEC