Input config for training.

Inherits From: DataConfig, Config, ParamsDict


default_params Dataclass field
restrictions Dataclass field
input_path Dataclass field
tfds_name Dataclass field
tfds_split Dataclass field
global_batch_size Dataclass field
is_training Dataclass field
drop_remainder Dataclass field
shuffle_buffer_size Dataclass field
cache Dataclass field
cycle_length Dataclass field
block_length Dataclass field
deterministic Dataclass field
sharding Dataclass field
enable_tf_data_service Dataclass field
tf_data_service_address Dataclass field
tf_data_service_job_name Dataclass field
tfds_data_dir Dataclass field
tfds_as_supervised Dataclass field
tfds_skip_decoding_feature Dataclass field
enable_shared_tf_data_service_between_parallel_trainers Dataclass field
apply_tf_data_service_before_batching Dataclass field
trainer_id Dataclass field
seed Dataclass field
prefetch_buffer_size Dataclass field
autotune_algorithm Dataclass field
image_feature Dataclass field
output_size Dataclass field
crop_size Dataclass field
weights Dataclass field
dtype Dataclass field
resize_eval_groundtruth Dataclass field
groundtruth_padded_size Dataclass field
aug_scale_min Dataclass field
aug_scale_max Dataclass field
aug_rand_hflip Dataclass field
preserve_aspect_ratio Dataclass field
aug_policy Dataclass field
file_type Dataclass field
decoder Dataclass field
additional_dense_features Dataclass field



View source

Returns a dict representation of params_dict.ParamsDict.

For the nested params_dict.ParamsDict, a nested dict will be returned.


View source

Builds a config from the given list of arguments.


View source

Wrapper for from_yaml.


View source


View source

Accesses through built-in dictionary get method.


View source

Makes the ParamsDict immutable.


View source

Override the ParamsDict with a set of given params.

override_params a dict or a ParamsDict specifying the parameters to be overridden.
is_strict a boolean specifying whether override is strict or not. If True, keys in override_params must be present in the ParamsDict. If False, keys in override_params can be different from what is currently defined in the ParamsDict. In this case, the ParamsDict will be extended to include the new keys.


View source

Overrides/returns a unlocked copy with the current config unchanged.


View source

Validate the parameters consistency based on the restrictions.

This method validates the internal consistency using the pre-defined list of restrictions. A restriction is defined as a string which specifies a binary operation. The supported binary operations are {'==', '!=', '<', '<=', '>', '>='}. Note that the meaning of these operators are consistent with the underlying Python immplementation. Users should make sure the define restrictions on their type make sense.

For example, for a ParamsDict like the following

  a1: 1
  a2: 2
    bb1: 10
    bb2: 20
    a1: 1
    a3: 3

one can define two restrictions like this ['a.a1 == b.ccc.a1', 'a.a2 <=']

What it enforces are

  • a.a1 = 1 == b.ccc.a1 = 1
  • a.a2 = 2 <= = 20

KeyError if any of the following happens (1) any of parameters in any of restrictions is not defined in ParamsDict, (2) any inconsistency violating the restriction is found.
ValueError if the restriction defined in the string is not supported.


View source

Implements the membership test operator.


IMMUTABLE_TYPES (<class 'str'>, <class 'int'>, <class 'float'>, <class 'bool'>, <class 'NoneType'>)
RESERVED_ATTR ['_locked', '_restrictions']
SEQUENCE_TYPES (<class 'list'>, <class 'tuple'>)
apply_tf_data_service_before_batching False
aug_policy None
aug_rand_hflip True
aug_scale_max 1.0
aug_scale_min 1.0
autotune_algorithm None
block_length 1
cache False
cycle_length 10
default_params None
deterministic None
drop_remainder True
dtype 'float32'
enable_shared_tf_data_service_between_parallel_trainers False
enable_tf_data_service False
file_type 'tfrecord'
global_batch_size 0
input_path None
is_training True
prefetch_buffer_size None
preserve_aspect_ratio True
resize_eval_groundtruth True
restrictions None
seed None
sharding True
shuffle_buffer_size 1000
tf_data_service_address None
tf_data_service_job_name None
tfds_as_supervised False
tfds_data_dir ''
tfds_name ''
tfds_skip_decoding_feature ''
tfds_split ''
trainer_id None
weights None