reddit_tifu

Les références:

court

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:reddit_tifu/short')
  • Description :
Reddit dataset, where TIFU denotes the name of subbreddit /r/tifu.
As defined in the publication, styel "short" uses title as summary and
"long" uses tldr as summary.

Features includes:
  - document: post text without tldr.
  - tldr: tldr line.
  - title: trimmed title without tldr.
  - ups: upvotes.
  - score: score.
  - num_comments: number of comments.
  - upvote_ratio: upvote ratio.
  • Licence : Aucune licence connue
  • Version : 1.1.0
  • Divisions :
Diviser Exemples
'train' 79740
  • Caractéristiques :
{
    "ups": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "num_comments": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "upvote_ratio": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "score": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "documents": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "tldr": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "title": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

long

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:reddit_tifu/long')
  • Description :
Reddit dataset, where TIFU denotes the name of subbreddit /r/tifu.
As defined in the publication, styel "short" uses title as summary and
"long" uses tldr as summary.

Features includes:
  - document: post text without tldr.
  - tldr: tldr line.
  - title: trimmed title without tldr.
  - ups: upvotes.
  - score: score.
  - num_comments: number of comments.
  - upvote_ratio: upvote ratio.
  • Licence : Aucune licence connue
  • Version : 1.1.0
  • Divisions :
Diviser Exemples
'train' 42139
  • Caractéristiques :
{
    "ups": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "num_comments": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "upvote_ratio": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "score": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "documents": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "tldr": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "title": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}