ニューラルコード検索

参考文献:

評価データセット

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:neural_code_search/evaluation_dataset')
  • 説明
Neural-Code-Search-Evaluation-Dataset presents an evaluation dataset consisting of natural language query and code snippet pairs and a search corpus consisting of code snippets collected from the most popular Android repositories on GitHub.
  • ライセンス: CC-BY-NC 4.0 (非営利目的)
  • バージョン: 1.1.0
  • 分割:
スプリット
'train' 287
  • 特徴
{
    "stackoverflow_id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "question_url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "question_author": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "question_author_url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "answer": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "answer_url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "answer_author": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "answer_author_url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "examples": {
        "feature": {
            "dtype": "int32",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "examples_url": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

検索コーパス

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:neural_code_search/search_corpus')
  • 説明
Neural-Code-Search-Evaluation-Dataset presents an evaluation dataset consisting of natural language query and code snippet pairs and a search corpus consisting of code snippets collected from the most popular Android repositories on GitHub.
  • ライセンス: CC-BY-NC 4.0 (非営利目的)
  • バージョン: 1.1.0
  • 分割:
スプリット
'train' 4716814
  • 特徴
{
    "id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "filepath": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "method_name": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "start_line": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "end_line": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "url": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}