![]() |
Wraps proto.SplitInfo
with an additional property.
tfds.core.SplitInfo(
shard_lengths: List[int],
num_bytes: int,
statistics: statistics_pb2.DatasetFeatureStatistics = <factory>,
_dataset_name: Optional[str] = None
)
Attributes | |
---|---|
name
|
Name of the split (e.g. train , test ,...)
|
shard_lengths
|
List of length |
num_examples
|
Total number of examples (sum(shard_lengths) )
|
num_shards
|
Number of files (len(shard_lengths) )
|
num_bytes
|
Size of the files |
statistics
|
Additional statistics of the split. |
file_instructions
|
Returns the list of dict(filename, take, skip).
This allows for creating your own
When |
filenames
|
Returns the list of filenames. |
Methods
from_proto
@classmethod
from_proto( proto: proto_lib.SplitInfo ) -> "SplitInfo"
replace
replace(
**kwargs
) -> "SplitInfo"
Returns a copy of the SplitInfo
with updated attributes.
to_proto
to_proto() -> proto_lib.SplitInfo