sogou_news

참조:

다음 명령을 사용하여 TFDS에서 이 데이터세트를 로드합니다.

ds = tfds.load('huggingface:sogou_news')
  • 설명 :
The Sogou News dataset is a mixture of 2,909,551 news articles from the SogouCA and SogouCS news corpora, in 5 categories. 
The number of training samples selected for each class is 90,000 and testing 12,000. Note that the Chinese characters have been converted to Pinyin.
classification labels of the news are determined by their domain names in the URL. For example, the news with
URL http://sports.sohu.com is categorized as a sport class.
  • 라이선스 : 알려진 라이선스 없음
  • 버전 : 0.0.0
  • 분할 :
나뉘다
'test' 60000
'train' 450000
  • 특징 :
{
    "title": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "content": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "label": {
        "num_classes": 5,
        "names": [
            "sports",
            "finance",
            "entertainment",
            "automobile",
            "technology"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}