dirigeable

Les références:

• Code
• Visage câlin

île_adjointe

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/adjunct_island')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

anaphore_gender_agreement

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/anaphor_gender_agreement')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

anaphor_number_agreement

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/anaphor_number_agreement')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

animer_subject_passive

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/animate_subject_passive')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

animer_subject_trans

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/animate_subject_trans')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

causal

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/causative')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

complexe_NP_island

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/complex_NP_island')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

coordinate_structure_constraint_complex_left_branch

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/coordinate_structure_constraint_complex_left_branch')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

coordinate_structure_constraint_object_extraction

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/coordinate_structure_constraint_object_extraction')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_irregular_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_irregular_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_irregular_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_irregular_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_with_adj_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_with_adj_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_with_adj_irregular_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_with_adj_irregular_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_with_adj_irregular_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_with_adj_irregular_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

déterminant_noun_agreement_with_adjective_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/determiner_noun_agreement_with_adjective_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

Distractor_agreement_relational_noun

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/distractor_agreement_relational_noun')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

Distractor_agreement_relative_clause

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/distractor_agreement_relative_clause')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

drop_argument

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/drop_argument')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

points de suspension_n_bar_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/ellipsis_n_bar_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

points de suspension_n_bar_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/ellipsis_n_bar_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

existential_there_object_raising

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/existential_there_object_raising')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

existential_there_quantifiers_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/existential_there_quantifiers_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

existential_there_quantifiers_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/existential_there_quantifiers_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

existential_there_subject_raising

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/existential_there_subject_raising')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

expletive_it_object_raising

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/expletive_it_object_raising')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

inchoatif

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/inchoative')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

intransitif

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/intransitive')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

irregulier_past_participle_adjectives

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/irregular_past_participle_adjectives')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

irrégulière_past_participle_verbs

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/irregular_past_participle_verbs')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

irregulier_plural_subject_verb_agreement_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/irregular_plural_subject_verb_agreement_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

irregulier_plural_subject_verb_agreement_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/irregular_plural_subject_verb_agreement_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

left_branch_island_echo_question

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/left_branch_island_echo_question')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

left_branch_island_simple_question

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/left_branch_island_simple_question')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

matrice_question_npi_licensor_present

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/matrix_question_npi_licensor_present')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

npi_present_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/npi_present_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

npi_present_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/npi_present_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

only_npi_licensor_present

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/only_npi_licensor_present')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

only_npi_scope

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/only_npi_scope')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

passif_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/passive_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

passif_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/passive_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_c_commande

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_c_command')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_case_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_case_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_case_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_case_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_domain_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_domain_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_domain_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_domain_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_domain_3

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_domain_3')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

principe_A_reconstruction

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/principle_A_reconstruction')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

régular_plural_subject_verb_agreement_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/regular_plural_subject_verb_agreement_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

régular_plural_subject_verb_agreement_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/regular_plural_subject_verb_agreement_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

sentential_negation_npi_licensor_present

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/sentential_negation_npi_licensor_present')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

sentential_negation_npi_scope

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/sentential_negation_npi_scope')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

sentential_subject_island

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/sentential_subject_island')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

superlative_quantifiers_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/superlative_quantifiers_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

superlative_quantifiers_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/superlative_quantifiers_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

hard_vs_raising_1

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/tough_vs_raising_1')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

dur_vs_raising_2

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/tough_vs_raising_2')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

transitif

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/transitive')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

quelle_île

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_island')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_questions_object_gap

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_questions_object_gap')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_questions_subject_gap

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_questions_subject_gap')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_questions_subject_gap_long_distance

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_questions_subject_gap_long_distance')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_vs_that_no_gap

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_vs_that_no_gap')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_vs_that_no_gap_long_distance

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_vs_that_no_gap_long_distance')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_vs_that_with_gap

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_vs_that_with_gap')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}

wh_vs_that_with_gap_long_distance

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:blimp/wh_vs_that_with_gap_long_distance')

• Description :

BLiMP is a challenge set for evaluating what language models (LMs) know about
major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each
containing 1000 minimal pairs isolating specific contrasts in syntax,
morphology, or semantics. The data is automatically generated according to
expert-crafted grammars.

• Licence : Aucune licence connue
• Version : 0.1.0
• Divisions :

• Caractéristiques :

{
    "sentence_good": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentence_bad": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "field": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "linguistics_term": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "UID": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "simple_LM_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "one_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "two_prefix_method": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "lexically_identical": {
        "dtype": "bool",
        "id": null,
        "_type": "Value"
    },
    "pair_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    }
}