id_liputan6

อ้างอิง:

ตามบัญญัติ

ใช้คำสั่งต่อไปนี้เพื่อโหลดชุดข้อมูลนี้ใน TFDS:

ds = tfds.load('huggingface:id_liputan6/canonical')
  • คำอธิบาย :
In this paper, we introduce a large-scale Indonesian summarization dataset. We harvest articles from this http URL,
an online news portal, and obtain 215,827 document-summary pairs. We leverage pre-trained language models to develop
benchmark extractive and abstractive summarization methods over the dataset with multilingual and monolingual
BERT-based models. We include a thorough error analysis by examining machine-generated summaries that have
low ROUGE scores, and expose both issues with ROUGE it-self, as well as with extractive and abstractive
summarization models.
  • ใบอนุญาต : ไม่มีใบอนุญาตที่รู้จัก
  • เวอร์ชัน : 1.0.0
  • แยก :
แยก ตัวอย่าง
'test' 10972
'train' 193883
'validation' 10972
  • คุณสมบัติ :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "clean_article": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "clean_summary": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "extractive_summary": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

สุดขีด

ใช้คำสั่งต่อไปนี้เพื่อโหลดชุดข้อมูลนี้ใน TFDS:

ds = tfds.load('huggingface:id_liputan6/xtreme')
  • คำอธิบาย :
In this paper, we introduce a large-scale Indonesian summarization dataset. We harvest articles from this http URL,
an online news portal, and obtain 215,827 document-summary pairs. We leverage pre-trained language models to develop
benchmark extractive and abstractive summarization methods over the dataset with multilingual and monolingual
BERT-based models. We include a thorough error analysis by examining machine-generated summaries that have
low ROUGE scores, and expose both issues with ROUGE it-self, as well as with extractive and abstractive
summarization models.
  • ใบอนุญาต : ไม่มีใบอนุญาตที่รู้จัก
  • เวอร์ชัน : 1.0.0
  • แยก :
แยก ตัวอย่าง
'test' 3862
'validation' 4948
  • คุณสมบัติ :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "clean_article": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "clean_summary": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "extractive_summary": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}