Have a question? Connect with the community at the TensorFlow Forum Visit Forum


Compute the split info on the given files.

Compute the split info (num shards, num examples,...) metadata required by tfds.folder_dataset.write_metadata.

See documentation for usage: https://www.tensorflow.org/datasets/external_tfrecord

data_dir Directory containing the .tfrecord files (or similar format)
out_dir Output directory on which save the metadata. It should be available from the apache beam workers.

split_infos The list of tfds.core.SplitInfo.