flores

  • Description:

Evaluation datasets for low-resource machine translation: Nepali-English and Sinhala-English.

@misc{guzmn2019new,
    title={Two New Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English},
    author={Francisco Guzman and Peng-Jen Chen and Myle Ott and Juan Pino and Guillaume Lample and Philipp Koehn and Vishrav Chaudhary and Marc'Aurelio Ranzato},
    year={2019},
    eprint={1902.01382},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

flores/neen_plain_text (default config)

  • Config description: Translation dataset from ne to en, uses encoder plain_text.

  • Dataset size: 1.89 MiB

  • Splits:

Split Examples
'test' 2,835
'validation' 2,559
  • Features:
Translation({
    'en': Text(shape=(), dtype=tf.string),
    'ne': Text(shape=(), dtype=tf.string),
})

flores/sien_plain_text

  • Config description: Translation dataset from si to en, uses encoder plain_text.

  • Dataset size: 2.05 MiB

  • Splits:

Split Examples
'test' 2,766
'validation' 2,898
  • Features:
Translation({
    'en': Text(shape=(), dtype=tf.string),
    'si': Text(shape=(), dtype=tf.string),
})