msr_text_compression

참조:

다음 명령을 사용하여 TFDS에서 이 데이터세트를 로드합니다.

ds = tfds.load('huggingface:msr_text_compression')
  • 설명 :
This dataset contains sentences and short paragraphs with corresponding shorter (compressed) versions. There are up to five compressions for each input text, together with quality judgements of their meaning preservation and grammaticality. The dataset is derived using source texts from the Open American National Corpus (ww.anc.org) and crowd-sourcing.
  • 라이선스 : Microsoft Research 데이터 라이선스 계약
  • 버전 : 1.1.0
  • 분할 :
나뉘다
'test' 785
'train' 4936
'validation' 447
  • 특징 :
{
    "source_id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "domain": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "source_text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "targets": {
        "feature": {
            "compressed_text": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "judge_id": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "num_ratings": {
                "dtype": "int64",
                "id": null,
                "_type": "Value"
            },
            "ratings": {
                "feature": {
                    "dtype": "int64",
                    "id": null,
                    "_type": "Value"
                },
                "length": -1,
                "id": null,
                "_type": "Sequence"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}