multi_nli_mismatch

The Multi-Genre Natural Language Inference (MultiNLI) corpus is a crowd-sourced collection of 433k sentence pairs annotated with textual entailment information. The corpus is modeled on the SNLI corpus, but differs in that covers a range of genres of spoken and written text, and supports a distinctive cross-genre generalization evaluation. The corpus served as the basis for the shared task of the RepEval 2017 Workshop at EMNLP in Copenhagen.

multi_nli_mismatch is configured with tfds.text.multi_nli_mismatch.MultiNLIMismatchConfig and has the following configurations predefined (defaults to the first one):

  • plain_text (v0.0.1) (Size: 216.34 MiB): Plain text

multi_nli_mismatch/plain_text

Plain text

Versions:

  • 0.0.1 (default):

Statistics

Split Examples
ALL 402,702
TRAIN 392,702
VALIDATION 10,000

Features

FeaturesDict({
    'hypothesis': Text(shape=(), dtype=tf.string),
    'label': Text(shape=(), dtype=tf.string),
    'premise': Text(shape=(), dtype=tf.string),
})

Homepage

Citation

@InProceedings{N18-1101,
  author = "Williams, Adina
            and Nangia, Nikita
            and Bowman, Samuel",
  title = "A Broad-Coverage Challenge Corpus for
           Sentence Understanding through Inference",
  booktitle = "Proceedings of the 2018 Conference of
               the North American Chapter of the
               Association for Computational Linguistics:
               Human Language Technologies, Volume 1 (Long
               Papers)",
  year = "2018",
  publisher = "Association for Computational Linguistics",
  pages = "1112--1122",
  location = "New Orleans, Louisiana",
  url = "http://aclweb.org/anthology/N18-1101"
}