oscar

Les références:

• Code
• Visage câlin

unshuffled_deduplicated_af

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_af')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_als

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_als')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_arz

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_arz')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_an

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_an')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ast

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ast')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ba

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ba')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_am

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_am')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_as

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_as')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_azb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_azb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_be

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_be')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bxr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bxr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ceb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ceb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_az

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_az')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bcl

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bcl')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_dsb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_dsb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bs

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bs')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ce

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ce')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_cv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_diq

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_diq')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_eml

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eml')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_et

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_et')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bg

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bg')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_bpy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bpy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ca

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ca')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ckb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ckb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ar

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ar')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement l’œuvre protégée par le droit d’auteur qui aurait été violée.
  • Identifiez clairement le matériel prétendument en infraction et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous répondrons aux demandes légitimes en supprimant les sources concernées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_av

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_av')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées sous ce régime de licence. Nous ne possédons aucun des textes à partir desquels ces données ont été extraites. Nous accordons une licence pour le packaging lui-même de ces données sous la licence Creative Commons CC0 (« aucun droit réservé ») http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible par la loi, Inria a renoncé à tout droit d'auteur et droits d'auteur ou connexes. droits voisins d'OSCAR Cet ouvrage est publié à partir de : France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne doivent donc pas être reproduites ici, veuillez :

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail auxquelles vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_Dedupliated_bar

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bar')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_bh

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_bh')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_br

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_br')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_cbk

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cbk')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_da

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_da')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_dv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_dv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_eo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_eo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_fa

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fa')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_fy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_gn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_Dedupliated_cs

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_cs')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_hi

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hi')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_Dedupliated_hu

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hu')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_ie

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ie')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_fr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_Dedupliated_gd

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gd')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_gu

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gu')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_hsb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hsb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_ia

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ia')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_io

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_io')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_jbo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_jbo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_km

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_km')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_Dedupliated_ku

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ku')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_la

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_la')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_lmo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lmo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_lv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_Dedupliated_min

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_min')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliqué_mr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_mwl

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mwl')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Si vous considérez que nos données contiennent du matériel qui vous appartient et ne devrait donc pas être reproduit ici, s'il vous plaît:

  • Identifiez-vous clairement, avec des données de contact détaillées telles qu'une adresse, un numéro de téléphone ou une adresse e-mail à laquelle vous pouvez être contacté.
  • Identifiez clairement le travail protégé par le droit d'auteur prétendu.
  • Identifiez clairement le matériel qui est censé être infiltré et les informations raisonnablement suffisantes pour nous permettre de localiser le matériel.

  Nous nous conformerons aux demandes légitimes en supprimant les sources affectées de la prochaine version du corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

non taillé_dedupliated_nah

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nah')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• Licence : Ces données sont publiées dans le cadre de ce schéma de licence, nous ne possédons aucun texte à partir duquel ces données ont été extraites. Nous concédons l'emballage réel de ces données sous la licence Creative Commons CC0 ("Pas de droits réservés") http://creativecommons.org/publicdomain/zero/1.0/ Dans la mesure du possible en vertu de la loi, INRIA a renoncé à tous Droits voisins à Oscar Ce travail est publié à partir de: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_new

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_new')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_oc

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_oc')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pam

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pam')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ps

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ps')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_it

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_it')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ka

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ka')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ro

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ro')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_scn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_scn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ko

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ko')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kw

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kw')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lez

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lez')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lrc

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lrc')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mg

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mg')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ml

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ml')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ms

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ms')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_myv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_myv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nds

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nds')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_nn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_nn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_os

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_os')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pms

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pms')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_qu

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_qu')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sa

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sa')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sk

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sk')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sh

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sh')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_so

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_so')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ta

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ta')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tk

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tk')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tyv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tyv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_uz

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_uz')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_wa

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_wa')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_xmf

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_xmf')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tg

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tg')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_de

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_de')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_el

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_el')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_uk

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_uk')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vi

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vi')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_wuu

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_wuu')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_als

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_als')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_arz

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_arz')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_az

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_az')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bcl

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bcl')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bs

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bs')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ce

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ce')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_cv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_diq

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_diq')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eml

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_eml')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_et

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_et')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_zh

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_zh')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_an

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_an')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ast

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ast')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ba

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ba')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bg

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bg')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bpy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bpy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ca

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ca')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ckb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ckb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_es

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_es')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_da

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_da')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_dv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_dv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_eo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_eo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_fi

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_fi')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ga

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ga')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_gom

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_gom')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_hy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_hy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ilo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ilo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fa

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_fa')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_fy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_gn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hi

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_hi')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hu

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_hu')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ie

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ie')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ja

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ja')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_kk

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_kk')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_krc

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_krc')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ky

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ky')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_li

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_li')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_lt

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_lt')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mhr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mhr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mt

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mt')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_mzn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_mzn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ne

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ne')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_no

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_no')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pa

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pa')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_pnb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_pnb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_rm

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_rm')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sah

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sah')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_si

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_si')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sq

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sq')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_sw

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_sw')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_th

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_th')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_tt

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_tt')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_ur

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_ur')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_vo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_vo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_xal

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_xal')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_deduplicated_yue

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_deduplicated_yue')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_am

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_am')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_as

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_as')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_azb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_azb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_be

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_be')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_bxr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_bxr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ceb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ceb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_cy

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_cy')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_dsb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_dsb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_fr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_fr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gd

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_gd')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_gu

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_gu')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_hsb

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_hsb')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ia

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ia')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_io

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_io')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_jbo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_jbo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_km

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_km')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ku

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ku')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_la

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_la')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lmo

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_lmo')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_lv

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_lv')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_min

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_min')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_mr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_mwl

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_mwl')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_nah

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_nah')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_new

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_new')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_oc

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_oc')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_pam

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_pam')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ps

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ps')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ro

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ro')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_scn

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_scn')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sk

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_sk')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_sr

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_sr')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :

• Caractéristiques :

{
    "id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

unshuffled_original_ta

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:oscar/unshuffled_original_ta')

• Description :

The Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture.

• License : These data are released under this licensing scheme We do not own any of the text from which these data has been extracted. We license the actual packaging of these data under the Creative Commons CC0 license ("no rights reserved") http://creativecommons.org/publicdomain/zero/1.0/ To the extent possible under law, Inria has waived all copyright and related or neighboring rights to OSCAR This work is published from: France.

  Should you consider that our data contains material that is owned by you and should therefore not be reproduced here, please:

  • Clearly identify yourself, with detailed contact data such as an address, telephone number or email address at which you can be contacted.
  • Clearly identify the copyrighted work claimed to be infringed.
  • Clearly identify the material that is claimed to be infringing and information reasonably sufficient to allow us to locate the material.

  We will comply to legitimate requests by removing the affected sources from the next release of the corpus.

• Version : 1.0.0

• Divisions :