স্টেরিওসেট

তথ্যসূত্র:

ইন্টারসেন্টেন্স

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:stereoset/intersentence')
  • বর্ণনা :
Stereoset is a dataset that measures stereotype bias in language models. Stereoset consists of 17,000 sentences that
measures model preferences across gender, race, religion, and profession.
  • লাইসেন্স : CC BY-SA 4.0
  • সংস্করণ : 1.0.0
  • বিভাজন :
বিভক্ত উদাহরণ
'validation' 2123
  • বৈশিষ্ট্য :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "target": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "bias_type": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "context": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentences": {
        "feature": {
            "sentence": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "id": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "labels": {
                "feature": {
                    "label": {
                        "num_classes": 4,
                        "names": [
                            "anti-stereotype",
                            "stereotype",
                            "unrelated",
                            "related"
                        ],
                        "names_file": null,
                        "id": null,
                        "_type": "ClassLabel"
                    },
                    "human_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                },
                "length": -1,
                "id": null,
                "_type": "Sequence"
            },
            "gold_label": {
                "num_classes": 3,
                "names": [
                    "anti-stereotype",
                    "stereotype",
                    "unrelated"
                ],
                "names_file": null,
                "id": null,
                "_type": "ClassLabel"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

অন্তর্নিহিততা

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:stereoset/intrasentence')
  • বর্ণনা :
Stereoset is a dataset that measures stereotype bias in language models. Stereoset consists of 17,000 sentences that
measures model preferences across gender, race, religion, and profession.
  • লাইসেন্স : CC BY-SA 4.0
  • সংস্করণ : 1.0.0
  • বিভাজন :
বিভক্ত উদাহরণ
'validation' 2106
  • বৈশিষ্ট্য :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "target": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "bias_type": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "context": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentences": {
        "feature": {
            "sentence": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "id": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "labels": {
                "feature": {
                    "label": {
                        "num_classes": 4,
                        "names": [
                            "anti-stereotype",
                            "stereotype",
                            "unrelated",
                            "related"
                        ],
                        "names_file": null,
                        "id": null,
                        "_type": "ClassLabel"
                    },
                    "human_id": {
                        "dtype": "string",
                        "id": null,
                        "_type": "Value"
                    }
                },
                "length": -1,
                "id": null,
                "_type": "Sequence"
            },
            "gold_label": {
                "num_classes": 3,
                "names": [
                    "anti-stereotype",
                    "stereotype",
                    "unrelated"
                ],
                "names_file": null,
                "id": null,
                "_type": "ClassLabel"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}