ヘンドリックステスト

参考文献:

抽象代数

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/abstract_algebra')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

解剖学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/anatomy')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 135
'validation' 14
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

天文学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/astronomy')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 152
'validation' 16
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

ビジネス倫理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/business_ethics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

臨床知識

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/clinical_knowledge')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 265
'validation' 29
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学生物学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_biology')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 144
'validation' 16
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学化学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_chemistry')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 8
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学コンピュータ科学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_computer_science')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学_数学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_mathematics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学_医学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_medicine')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 173
'validation' 22
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学物理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_physics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 102
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

コンピュータセキュリティ

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/computer_security')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

概念的物理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/conceptual_physics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 235
'validation' 26
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

計量経済学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/econometrics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 114
'validation' 12
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

電気工学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/electrical_engineering')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 145
'validation' 16
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

初等数学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/elementary_mathematics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 378
'validation' 41
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

フォーマルロジック

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/formal_logic')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 126
'validation' 14
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

グローバルファクト

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/global_facts')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 10
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校生物学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_biology')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 310
'validation' 32
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校の化学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_chemistry')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 203
'validation' 22
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校_コンピューター_サイエンス

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_computer_science')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 9
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校ヨーロッパの歴史

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_european_history')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 165
'validation' 18
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校地理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_geography')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 198
'validation' 22
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校と政府と政治

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_government_and_politics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 193
'validation' 21
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校マクロ経済学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_macroeconomics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 390
'validation' 43
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校数学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_mathematics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 270
'validation' 29
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校_ミクロ経済学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_microeconomics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 238
'validation' 26
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校物理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_physics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 151
'validation' 17
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校心理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_psychology')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 545
'validation' 60
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校統計

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_statistics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 216
'validation' 23
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校の歴史

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_us_history')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 204
'validation' 22
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校世界史

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_world_history')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 237
'validation' 26
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

人間の老化

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/human_aging')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 223
'validation' 23
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

人間のセクシュアリティ

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/human_sexuality')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 131
'validation' 12
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

国際法

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/international_law')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 121
'validation' 13
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

法学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/jurisprudence')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 108
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

論理的誤り

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/logical_fallacies')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 163
'validation' 18
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

機械学習

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/machine_learning')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 112
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

管理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/management')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 103
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

マーケティング

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/marketing')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 234
'validation' 25
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

医療遺伝学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/medical_genetics')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

その他

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/miscellaneous')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 783
'validation' 86
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

道徳的紛争

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/moral_disputes')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 346
'validation' 38
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

道徳シナリオ

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/moral_scenarios')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 895
'validation' 100
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

栄養

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/nutrition')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 306
'validation' 33
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

哲学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/philosophy')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 311
'validation' 34
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

先史時代

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/prehistory')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 324
'validation' 35
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

プロフェッショナル_会計

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_accounting')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 282
'validation' 31
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

専門法

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_law')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 1534年
'validation' 170
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

専門_医学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_medicine')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 272
'validation' 31
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

専門心理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_psychology')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 612
'validation' 69
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

広報

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/public_relations')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 110
'validation' 12
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

セキュリティ研究

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/security_studies')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 245
'validation' 27
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

社会学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/sociology')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 201
'validation' 22
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

us_foreign_policy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/us_foreign_policy')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 100
'validation' 11
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

ウイルス学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/virology')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 166
'validation' 18
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

世界の宗教

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/world_religions')
  • 説明
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.
  • ライセンス: 不明なライセンス
  • バージョン: 1.0.0
  • 分割:
スプリット
'auxiliary_train' 99842
'dev' 5
'test' 171
'validation' 19
  • 特徴
{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}