オスカー

参考文献:

• コード
• ハグフェイス

unshuffled_deduplicated_af

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_af')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_als

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_als')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_arz

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_arz')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_an

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_an')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ast

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ast')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ba

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ba')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_am

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_am')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_as

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_as')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_azb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_azb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_be

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_be')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bxr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bxr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ceb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ceb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_az

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_az')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bcl

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bcl')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_dsb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_dsb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bs

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bs')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ce

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ce')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_diq

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_diq')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_eml

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eml')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_et

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_et')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bg

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bg')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bpy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bpy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ca

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ca')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ckb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ckb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ar

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ar')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害していると主張される素材と、その素材を特定するために合理的に十分な情報を明確に特定します。

  私たちは、正当な要求に応じて、コーパスの次のリリースから影響を受けるソースを削除します。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_av

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_av')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス: これらのデータは、このライセンス スキームに基づいてリリースされています。当社は、これらのデータが抽出されたテキストを所有しません。当社は、これらのデータの実際のパッケージ化をクリエイティブ コモンズ CC0 ライセンス (「権利留保なし」) http://creativecommons.org/publicdomain/zero/1.0/に基づいてライセンス供与しています。法律で可能な範囲で、Inria はすべての著作権および関連する著作権を放棄しています。 OSCAR に対する著作隣接権 この作品はフランスから発行されています。

  当社のデータにはお客様が所有する素材が含まれているため、ここで複製すべきではないと考えられる場合は、次のことを行ってください。

  • 連絡先の住所、電話番号、電子メール アドレスなどの詳細な連絡先データを使用して、自分自身を明確に特定します。
  • 侵害されていると主張される著作物を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bar

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bar')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bh

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bh')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_br

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_br')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cbk

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cbk')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_da

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_da')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_dv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_dv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_eo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fa

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fa')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cs

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cs')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hi

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hi')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hu

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hu')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ie

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ie')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gd

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gd')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gu

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gu')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hsb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hsb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ia

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ia')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_io

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_io')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_jbo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_jbo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_km

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_km')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ku

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ku')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_la

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_la')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lmo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lmo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_min

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_min')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mwl

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mwl')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  私たちのデータにはあなたが所有している資料が含まれているため、ここで再現すべきではないと考える場合は、次のことをお願いします。

  • アドレス、電話番号、電子メールアドレスなどの詳細な連絡先データを使用して、連絡先などの詳細な連絡先データを明確に識別します。
  • 侵害されていると主張されている著作権で保護された作業を明確に特定します。
  • 侵害されていると主張されている材料と、私たちが材料を見つけることができるように合理的に十分な情報を明確に特定します。

  コーパスの次のリリースから影響を受けるソースを削除することにより、合法的な要求に従います。

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nah

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nah')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• ライセンス：これらのデータは、このライセンススキームでリリースされ、これらのデータが抽出されたテキストを所有していません。これらのデータの実際のパッケージングは​​、Creative Commons CC0ライセンス（「権利を収納していない」） http://creativecommons.org/publicdomain/zero/1.0/で可能な限り、すべての著作権および関連または関連または関連または関連するかを放棄しましたオスカーの近隣の権利この作品は、フランスから出版されています。

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_new

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_new')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_oc

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_oc')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pam

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pam')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ps

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ps')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_it

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_it')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ka

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ka')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ro

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ro')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_scn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_scn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ko

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ko')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kw

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kw')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lez

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lez')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lrc

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lrc')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mg

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mg')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ml

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ml')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ms

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ms')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_myv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_myv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nds

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nds')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_os

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_os')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pms

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pms')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_qu

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_qu')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sa

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sa')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sk

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sk')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sh

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sh')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_so

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_so')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ta

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ta')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tk

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tk')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tyv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tyv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_uz

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_uz')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_wa

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_wa')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_xmf

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_xmf')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tg

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tg')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_de

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_de')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_el

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_el')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_uk

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_uk')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vi

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vi')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_wuu

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_wuu')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_als

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_als')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_arz

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_arz')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_az

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_az')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bcl

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bcl')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bs

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bs')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ce

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ce')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_cv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_diq

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_diq')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eml

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_eml')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_et

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_et')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_zh

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_zh')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_an

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_an')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ast

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ast')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ba

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ba')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bg

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bg')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bpy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bpy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ca

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ca')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ckb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ckb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_es

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_es')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_da

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_da')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_dv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_dv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_eo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fi

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fi')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ga

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ga')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gom

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gom')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ilo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ilo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fa

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_fa')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_fy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_gn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hi

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_hi')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hu

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_hu')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ie

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ie')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ja

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ja')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kk

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kk')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_krc

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_krc')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ky

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ky')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_li

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_li')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lt

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lt')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mhr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mhr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mt

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mt')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mzn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mzn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ne

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ne')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_no

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_no')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pa

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pa')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pnb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pnb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_rm

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_rm')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sah

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sah')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_si

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_si')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sq

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sq')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sw

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sw')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_th

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_th')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tt

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tt')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ur

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ur')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_xal

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_xal')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yue

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yue')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_am

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_am')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_as

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_as')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_azb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_azb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_be

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_be')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bxr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_bxr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ceb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ceb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_cy')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_dsb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_dsb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_fr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gd

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_gd')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gu

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_gu')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hsb

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_hsb')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ia

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ia')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_io

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_io')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_jbo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_jbo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_km

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_km')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ku

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ku')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_la

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_la')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lmo

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_lmo')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lv

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_lv')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_min

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_min')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_mr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mwl

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_mwl')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nah

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_nah')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_new

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_new')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_oc

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_oc')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pam

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_pam')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ps

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ps')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ro

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ro')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_scn

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_scn')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sk

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_sk')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sr

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_sr')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割:

• 特徴：

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ta

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:oscar/unshuffled_original_ta')

• 説明：

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• バージョン: 1.0.0

• 分割: