References:
cola
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/cola')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
1063 |
'train' |
8551 |
'validation' |
1043 |
- Features:
{
"sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"unacceptable",
"acceptable"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
sst2
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/sst2')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
1821 |
'train' |
67349 |
'validation' |
872 |
- Features:
{
"sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"negative",
"positive"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
mrpc
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/mrpc')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
1725 |
'train' |
3668 |
'validation' |
408 |
- Features:
{
"sentence1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sentence2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"not_equivalent",
"equivalent"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
qqp
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/qqp')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
390965 |
'train' |
363846 |
'validation' |
40430 |
- Features:
{
"question1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"not_duplicate",
"duplicate"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
stsb
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/stsb')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
1379 |
'train' |
5749 |
'validation' |
1500 |
- Features:
{
"sentence1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sentence2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"dtype": "float32",
"id": null,
"_type": "Value"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
mnli
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/mnli')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test_matched' |
9796 |
'test_mismatched' |
9847 |
'train' |
392702 |
'validation_matched' |
9815 |
'validation_mismatched' |
9832 |
- Features:
{
"premise": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"hypothesis": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 3,
"names": [
"entailment",
"neutral",
"contradiction"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
mnli_mismatched
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/mnli_mismatched')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
9847 |
'validation' |
9832 |
- Features:
{
"premise": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"hypothesis": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 3,
"names": [
"entailment",
"neutral",
"contradiction"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
mnli_matched
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/mnli_matched')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
9796 |
'validation' |
9815 |
- Features:
{
"premise": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"hypothesis": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 3,
"names": [
"entailment",
"neutral",
"contradiction"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
qnli
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/qnli')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
5463 |
'train' |
104743 |
'validation' |
5463 |
- Features:
{
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sentence": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"entailment",
"not_entailment"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
rte
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/rte')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
3000 |
'train' |
2490 |
'validation' |
277 |
- Features:
{
"sentence1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sentence2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"entailment",
"not_entailment"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
wnli
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/wnli')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
146 |
'train' |
635 |
'validation' |
71 |
- Features:
{
"sentence1": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sentence2": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 2,
"names": [
"not_entailment",
"entailment"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}
ax
Use the following command to load this dataset in TFDS:
ds = tfds.load('huggingface:glue/ax')
- Description:
GLUE, the General Language Understanding Evaluation benchmark
(https://gluebenchmark.com/) is a collection of resources for training,
evaluating, and analyzing natural language understanding systems.
- License: No known license
- Version: 1.0.0
- Splits:
Split | Examples |
---|---|
'test' |
1104 |
- Features:
{
"premise": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"hypothesis": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 3,
"names": [
"entailment",
"neutral",
"contradiction"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"idx": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
}