Attend the Women in ML Symposium on December 7 Register now


Stay organized with collections Save and categorize content based on your preferences.

Compute the split info for the splits in the given data dir.

out_dir directory where to save the metadata. It should be available from the apache beam workers. If not set, apache beam won't be used (only available with some file formats).
data_dir directory where the data is.
filename_template the template to which the data files correspond. If None, then the default template is used.

list of split infos for the splits in the given data dir.