Facebook Gives Away Its Largest Language Database For Free

Facebook’s AI wing recently announced that it will open-source its FLORES-101 database to allow researchers to benefit from the work and use it to improve multilingual translation models. FLORES-101 is a many-to-many evaluation data set which covers 101 different languages. The database is available, along with a tech report and models, here for free use by researchers and developers worldwide. Facebook claims that making such information publicly available will empower researchers to accelerate progress in many-to-many translation systems everywhere.  According to Facebook, ‘good benchmarks are difficult to construct’ and must display tangible differences between different translation models. Furthermore, such evaluation benchmarks need to maintain a high quality for every l