py_ast

참고자료:

ast

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:py_ast/ast')
  • 설명 :
dataset consisting of parsed Parsed ASTs that were used to train and
evaluate the DeepSyn tool.
The Python programs are collected from GitHub repositories
by removing duplicate files, removing project forks (copy of another existing repository)
,keeping only programs that parse and have at most 30'000 nodes in the AST and
we aim to remove obfuscated files
  • 라이센스 : 알려진 라이센스 없음
  • 버전 : 0.0.0
  • 분할 :
나뉘다
'test' 50000
'train' 100000
  • 특징 :
{
    "ast": {
        "feature": {
            "type": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "value": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "children": {
                "feature": {
                    "dtype": "int32",
                    "id": null,
                    "_type": "Value"
                },
                "length": -1,
                "id": null,
                "_type": "Sequence"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}