- Description:
A medical abbreviation expansion dataset which applies web-scale reverse substitution (wsrs) to the C4 dataset, which is a colossal, cleaned version of Common Crawl's web crawl corpus.
The original source is the Common Crawl dataset: https://commoncrawl.org
Config description: Default C4-WSRS dataset.
Homepage: https://github.com/google-research/google-research/tree/master/deciphering_clinical_abbreviations
Source code:
tfds.text.c4_wsrs.C4WSRS
Versions:
1.0.0
(default): Initial release.
Download size:
143.01 KiB
Dataset size:
5.84 GiB
Auto-cached (documentation): No
Splits:
Split | Examples |
---|---|
'train' |
9,575,852 |
'validation' |
991,422 |
- Feature structure:
FeaturesDict({
'abbreviated_snippet': Text(shape=(), dtype=string),
'original_snippet': Text(shape=(), dtype=string),
})
- Feature documentation:
Feature | Class | Shape | Dtype | Description |
---|---|---|---|---|
FeaturesDict | ||||
abbreviated_snippet | Text | string | ||
original_snippet | Text | string |
Supervised keys (See
as_supervised
doc):None
Figure (tfds.show_examples): Not supported.
Examples (tfds.as_dataframe):
- Citation: