ccaligned_다국어

참고자료:

• 암호
• 포옹하는 얼굴

문서-zz_TR

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:ccaligned_multilingual/documents-zz_TR')

• 설명 :

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

• 특징 :

{
    "Domain": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "Source_URL": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "Target_URL": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "en_XX",
            "zz_TR"
        ],
        "id": null,
        "_type": "Translation"
    }
}

문장-zz_TR

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:ccaligned_multilingual/sentences-zz_TR')

• 설명 :

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

• 특징 :

{
    "translation": {
        "languages": [
            "en_XX",
            "zz_TR"
        ],
        "id": null,
        "_type": "Translation"
    },
    "LASER_similarity": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    }
}

문서-tz_MA

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:ccaligned_multilingual/documents-tz_MA')

• 설명 :

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

• 특징 :

{
    "Domain": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "Source_URL": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "Target_URL": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "en_XX",
            "tz_MA"
        ],
        "id": null,
        "_type": "Translation"
    }
}

문장-tz_MA

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:ccaligned_multilingual/sentences-tz_MA')

• 설명 :

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

• 특징 :

{
    "translation": {
        "languages": [
            "en_XX",
            "tz_MA"
        ],
        "id": null,
        "_type": "Translation"
    },
    "LASER_similarity": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    }
}

문서-ak_GH

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:ccaligned_multilingual/documents-ak_GH')

• 설명 :

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

• 특징 :

{
    "Domain": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "Source_URL": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "Target_URL": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "translation": {
        "languages": [
            "en_XX",
            "ak_GH"
        ],
        "id": null,
        "_type": "Translation"
    }
}

문장-ak_GH

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:ccaligned_multilingual/sentences-ak_GH')

• 설명 :

CCAligned consists of parallel or comparable web-document pairs in 137 languages aligned with English. These web-document pairs were constructed by performing language identification on raw web-documents, and ensuring corresponding language codes were corresponding in the URLs of web documents. This pattern matching approach yielded more than 100 million aligned documents paired with English. Recognizing that each English document was often aligned to mulitple documents in different target language, we can join on English documents to obtain aligned documents that directly pair two non-English documents (e.g., Arabic-French).

• 라이센스 : 알려진 라이센스 없음
• 버전 : 1.0.0
• 분할 :

• 특징 :

{
    "translation": {
        "languages": [
            "en_XX",
            "ak_GH"
        ],
        "id": null,
        "_type": "Translation"
    },
    "LASER_similarity": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    }
}