tfds.download.DownloadConfig

Class DownloadConfig

Defined in core/download/download_manager.py.

Configuration for tfds.core.DatasetBuilder.download_and_prepare.

__init__

__init__(
    extract_dir=None,
    manual_dir=None,
    download_mode=None,
    compute_stats=None,
    max_examples_per_split=None
)

Constructs a DownloadConfig.

Args:

  • extract_dir: str, directory where extracted files are stored. Defaults to "/extracted".
  • manual_dir: str, read-only directory where manually downloaded/extracted data is stored. Defaults to "/manual".
  • download_mode: tfds.GenerateMode, how to deal with downloads or data that already exists. Defaults to REUSE_DATASET_IF_EXISTS, which will reuse both downloads and data if it already exists.
  • compute_stats: tfds.download.ComputeStats, whether to compute statistics over the generated data. Defaults to AUTO.
  • max_examples_per_split: int, optional max number of examples to write into each split.