Module: tfx.components.example_gen.utils

Utilities for ExampleGen components.

Functions

calculate_splits_fingerprint_span_and_version(...): Calculates the fingerprint of files in a URI matching split patterns.

dict_to_example(...): Converts dict to tf example.

generate_output_split_names(...): Return output split name based on input and output config.

make_default_input_config(...): Returns default input config.

make_default_output_config(...): Returns default output config based on input config.

Other Members

  • DATE_SPECS
  • DAY_SPEC = '{DD}'
  • EXAMPLES_KEY = 'examples'
  • FINGERPRINT_PROPERTY_NAME = 'input_fingerprint'
  • INPUT_BASE_KEY = 'input_base'
  • INPUT_CONFIG_KEY = 'input_config'
  • MONTH_SPEC = '{MM}'
  • OUTPUT_CONFIG_KEY = 'output_config'
  • OUTPUT_DATA_FORMAT_KEY = 'output_data_format'
  • PAYLOAD_FORMAT_PROPERTY_NAME = 'payload_format'
  • SPAN_PROPERTY_NAME = 'span'
  • SPAN_SPEC = '{SPAN}'
  • UNIX_EPOCH_DATE
  • VERSION_PROPERTY_NAME = 'version'
  • VERSION_SPEC = '{VERSION}'
  • YEAR_SPEC = '{YYYY}'