File size: 34,441 Bytes
ee0ec3d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 |
## Universal Dependencies 2.6 Models #universal_dependencies_26_models
Universal Dependencies 2.6 Models are distributed under the
[CC BY-NC-SA](https://creativecommons.org/licenses/by-nc-sa/4.0/) licence.
The models are based solely on [Universal Dependencies
2.6](https://hdl.handle.net/11234/1-3226) treebanks, and additionally
use [multilingual BERT](https://github.com/google-research/bert/blob/master/multilingual.md).
The models require [UDPipe 2](https://ufal.mff.cuni.cz/udpipe/2).
### Download
The latest version 200831 of the Universal Dependencies 2.6 models
can be downloaded from [LINDAT/CLARIN repository](https://hdl.handle.net/11234/1-4798).
The models are also available in the [REST service](https://lindat.mff.cuni.cz/services/udpipe/).
### Acknowledgements #universal_dependencies_26_models_acknowledgements
This work has been supported by the Ministry of Education, Youth and Sports of
the Czech Republic, Project No. LM2018101 LINDAT/CLARIAH-CZ.
The models were trained on [Universal Dependencies 2.6](https://hdl.handle.net/11234/1-3226) treebanks.
For the UD treebanks which do not contain original plain text version,
raw text is used to train the tokenizer instead. The plain texts
were taken from the [W2C -- Web to Corpus](https://hdl.handle.net/11858/00-097C-0000-0022-6133-9).
Finally, [multilingual BERT](https://github.com/google-research/bert/blob/master/multilingual.md)
is used to provide contextualized word embeddings.
### Publications
- Milan Straka, Jana StrakovΓ‘, Jan HajiΔ (2019): [Evaluating Contextualized Embeddings on 54 Languages in POS Tagging, Lemmatization and Dependency Parsing](https://arxiv.org/abs/1908.07448). In: ArXiv.org Computing Research Repository, ISSN 2331-8422, 1904.02099
- Milan Straka (2018): [UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task](https://www.aclweb.org/anthology/K18-2020/). In: Proceedings of CoNLL 2018: The SIGNLL Conference on Computational Natural Language Learning, pp. 197-207, Association for Computational Linguistics, Stroudsburg, PA, USA, ISBN 978-1-948087-72-8
### Model Description
The Universal Dependencies 2.6 models contain 99 models of 63 languages, each consisting of
a tokenizer, tagger, lemmatizer and dependency parser, all trained using
the UD data. We used the original train-dev-test split, but for treebanks with
only train and no dev data we used last 10% of the train data as dev data.
We produce models only for treebanks with at least 1000 training words.
The tokenizer is trained using the `SpaceAfter=No` features. If the features
are not present in the data, they can be filled in using raw text in the
language in question.
The tagger, lemmatizer and parser are trained using gold UD data.
### Model Performance
We present the tokenizer, tagger, lemmatizer and parser performance, measured on
the testing portion of the data, evaluated both on the raw text and using the
gold tokenization. The results are F1 scores measured by the `conll18_ud_eval.py`
script.
| Model | Mode | Words | Sents | UPOS | XPOS | UFeats | AllTags | Lemma | UAS | LAS | MLAS | BLEX |
|:------------------------|:-------------|-------:|-------:|------:|------:|--------:|--------:|-------:|------:|------:|------:|------:|
| afrikaans-afribooms-ud-2.6-200830 | Raw text | 99.82 | 98.25 | 98.55 | 95.42 | 98.27 | 95.33 | 97.52 | 90.34 | 87.93 | 80.33 | 79.91 |
| afrikaans-afribooms-ud-2.6-200830 | Gold tokenization | β | β | 98.70 | 95.56 | 98.41 | 95.48 | 97.61 | 90.80 | 88.40 | 80.78 | 80.31 |
| ancient_greek-perseus-ud-2.6-200830 | Raw text | 99.97 | 98.85 | 93.20 | 86.01 | 91.59 | 85.27 | 86.81 | 79.57 | 73.90 | 54.80 | 55.63 |
| ancient_greek-perseus-ud-2.6-200830 | Gold tokenization | β | β | 93.24 | 86.03 | 91.62 | 85.30 | 86.84 | 79.74 | 74.06 | 54.92 | 55.72 |
| ancient_greek-proiel-ud-2.6-200830 | Raw text | 100.00 | 48.02 | 97.73 | 98.04 | 92.36 | 91.01 | 94.71 | 79.98 | 75.99 | 60.15 | 65.88 |
| ancient_greek-proiel-ud-2.6-200830 | Gold tokenization | β | β | 97.91 | 98.18 | 92.59 | 91.30 | 94.76 | 85.95 | 81.90 | 66.72 | 71.84 |
| arabic-padt-ud-2.6-200830 | Raw text | 94.58 | 82.09 | 91.68 | 88.96 | 89.14 | 88.65 | 90.36 | 78.86 | 74.85 | 66.06 | 68.12 |
| arabic-padt-ud-2.6-200830 | Gold tokenization | β | β | 96.87 | 94.20 | 94.36 | 93.82 | 95.23 | 87.60 | 83.14 | 74.51 | 76.09 |
| armenian-armtdp-ud-2.6-200830 | Raw text | 99.34 | 97.85 | 95.64 | β | 90.30 | 88.94 | 94.45 | 85.07 | 79.97 | 66.54 | 71.61 |
| armenian-armtdp-ud-2.6-200830 | Gold tokenization | β | β | 96.11 | β | 90.90 | 89.37 | 95.04 | 86.31 | 81.18 | 67.00 | 72.22 |
| basque-bdt-ud-2.6-200830 | Raw text | 99.94 | 99.83 | 96.44 | β | 93.60 | 91.69 | 96.40 | 87.24 | 84.15 | 74.97 | 79.94 |
| basque-bdt-ud-2.6-200830 | Gold tokenization | β | β | 96.48 | β | 93.64 | 91.72 | 96.43 | 87.30 | 84.21 | 75.00 | 79.96 |
| belarusian-hse-ud-2.6-200830 | Raw text | 99.84 | 78.70 | 96.14 | 31.78 | 82.07 | 26.98 | 81.48 | 75.81 | 71.05 | 49.78 | 50.93 |
| belarusian-hse-ud-2.6-200830 | Gold tokenization | β | β | 96.39 | 31.85 | 82.19 | 27.08 | 81.53 | 80.18 | 75.18 | 52.92 | 53.60 |
| bulgarian-btb-ud-2.6-200830 | Raw text | 99.91 | 94.17 | 99.15 | 97.19 | 97.95 | 96.84 | 97.97 | 94.35 | 91.61 | 85.92 | 86.43 |
| bulgarian-btb-ud-2.6-200830 | Gold tokenization | β | β | 99.27 | 97.30 | 98.05 | 96.95 | 98.07 | 95.17 | 92.41 | 86.62 | 87.17 |
| catalan-ancora-ud-2.6-200830 | Raw text | 99.98 | 99.43 | 99.05 | 98.99 | 98.63 | 98.14 | 99.31 | 94.53 | 92.86 | 87.63 | 89.24 |
| catalan-ancora-ud-2.6-200830 | Gold tokenization | β | β | 99.09 | 99.03 | 98.67 | 98.18 | 99.34 | 94.60 | 92.95 | 87.73 | 89.35 |
| chinese-gsdsimp-ud-2.6-200830 | Raw text | 90.29 | 99.10 | 87.32 | 87.20 | 89.73 | 86.54 | 90.29 | 72.68 | 70.32 | 63.38 | 66.94 |
| chinese-gsdsimp-ud-2.6-200830 | Gold tokenization | β | β | 96.32 | 96.15 | 99.43 | 95.50 | 99.99 | 86.89 | 83.93 | 78.52 | 82.60 |
| chinese-gsd-ud-2.6-200830 | Raw text | 90.27 | 99.10 | 87.27 | 87.18 | 89.74 | 86.50 | 90.27 | 72.99 | 70.50 | 63.83 | 67.21 |
| chinese-gsd-ud-2.6-200830 | Gold tokenization | β | β | 96.30 | 96.16 | 99.42 | 95.45 | 99.99 | 87.30 | 84.22 | 78.63 | 82.84 |
| classical_chinese-kyoto-ud-2.6-200830 | Raw text | 99.46 | 46.22 | 90.91 | 90.91 | 93.43 | 88.00 | 99.42 | 72.75 | 67.18 | 63.67 | 66.02 |
| classical_chinese-kyoto-ud-2.6-200830 | Gold tokenization | β | β | 93.55 | 93.24 | 95.01 | 90.86 | 99.96 | 85.49 | 80.20 | 76.42 | 79.25 |
| coptic-scriptorium-ud-2.6-200830 | Raw text | 71.91 | 35.97 | 69.61 | 68.00 | 63.06 | 60.16 | 70.51 | 47.75 | 45.89 | 25.42 | 35.81 |
| coptic-scriptorium-ud-2.6-200830 | Gold tokenization | β | β | 96.15 | 92.53 | 87.75 | 81.98 | 96.70 | 89.14 | 85.79 | 57.57 | 76.42 |
| croatian-set-ud-2.6-200830 | Raw text | 99.95 | 94.41 | 98.18 | 95.91 | 96.40 | 95.27 | 97.58 | 92.20 | 88.40 | 80.16 | 83.07 |
| croatian-set-ud-2.6-200830 | Gold tokenization | β | β | 98.23 | 96.00 | 96.52 | 95.38 | 97.64 | 92.72 | 88.89 | 80.66 | 83.53 |
| czech-pdt-ud-2.6-200830 | Raw text | 99.93 | 93.35 | 99.23 | 97.61 | 97.59 | 97.13 | 99.09 | 93.81 | 92.03 | 87.79 | 89.88 |
| czech-pdt-ud-2.6-200830 | Gold tokenization | β | β | 99.30 | 97.71 | 97.70 | 97.24 | 99.17 | 94.60 | 92.81 | 88.45 | 90.57 |
| czech-cac-ud-2.6-200830 | Raw text | 99.98 | 99.68 | 99.52 | 97.33 | 97.05 | 96.64 | 98.93 | 94.31 | 92.48 | 87.56 | 89.76 |
| czech-cac-ud-2.6-200830 | Gold tokenization | β | β | 99.54 | 97.36 | 97.07 | 96.67 | 98.95 | 94.37 | 92.54 | 87.63 | 89.83 |
| czech-fictree-ud-2.6-200830 | Raw text | 99.99 | 98.95 | 98.68 | 95.80 | 96.79 | 95.38 | 99.20 | 94.83 | 92.66 | 85.35 | 89.58 |
| czech-fictree-ud-2.6-200830 | Gold tokenization | β | β | 98.69 | 95.82 | 96.80 | 95.40 | 99.21 | 94.92 | 92.74 | 85.47 | 89.69 |
| czech-cltt-ud-2.6-200830 | Raw text | 99.65 | 97.40 | 99.21 | 95.00 | 94.98 | 94.76 | 99.06 | 91.37 | 89.67 | 82.08 | 86.96 |
| czech-cltt-ud-2.6-200830 | Gold tokenization | β | β | 99.49 | 95.19 | 95.16 | 94.95 | 99.30 | 91.91 | 90.21 | 82.25 | 87.31 |
| danish-ddt-ud-2.6-200830 | Raw text | 99.81 | 89.78 | 98.01 | β | 97.52 | 96.72 | 97.31 | 88.56 | 86.46 | 79.62 | 81.12 |
| danish-ddt-ud-2.6-200830 | Gold tokenization | β | β | 98.26 | β | 97.73 | 96.99 | 97.53 | 89.82 | 87.67 | 80.73 | 82.27 |
| dutch-alpino-ud-2.6-200830 | Raw text | 99.83 | 88.59 | 97.41 | 95.98 | 97.02 | 95.36 | 97.32 | 92.79 | 90.38 | 81.53 | 83.18 |
| dutch-alpino-ud-2.6-200830 | Gold tokenization | β | β | 97.57 | 96.13 | 97.18 | 95.53 | 97.46 | 93.93 | 91.53 | 82.72 | 84.42 |
| dutch-lassysmall-ud-2.6-200830 | Raw text | 99.83 | 75.40 | 96.58 | 95.42 | 96.41 | 94.73 | 97.21 | 90.36 | 87.66 | 78.84 | 80.17 |
| dutch-lassysmall-ud-2.6-200830 | Gold tokenization | β | β | 96.79 | 96.05 | 96.97 | 95.40 | 97.33 | 94.26 | 91.24 | 83.56 | 84.84 |
| english-ewt-ud-2.6-200830 | Raw text | 98.95 | 86.60 | 96.36 | 96.06 | 96.56 | 94.88 | 97.64 | 89.55 | 87.43 | 80.50 | 83.29 |
| english-ewt-ud-2.6-200830 | Gold tokenization | β | β | 97.29 | 97.03 | 97.57 | 95.84 | 98.57 | 92.24 | 90.05 | 83.33 | 86.07 |
| english-gum-ud-2.6-200830 | Raw text | 99.81 | 83.66 | 96.79 | 96.76 | 97.55 | 95.88 | 97.35 | 90.02 | 87.52 | 79.41 | 80.43 |
| english-gum-ud-2.6-200830 | Gold tokenization | β | β | 96.99 | 96.93 | 97.75 | 96.09 | 97.56 | 91.93 | 89.36 | 81.20 | 82.25 |
| english-lines-ud-2.6-200830 | Raw text | 99.92 | 87.45 | 97.60 | 95.86 | 96.88 | 93.39 | 98.34 | 89.36 | 86.45 | 79.35 | 82.87 |
| english-lines-ud-2.6-200830 | Gold tokenization | β | β | 97.67 | 95.90 | 96.92 | 93.41 | 98.41 | 90.26 | 87.36 | 80.24 | 83.79 |
| english-partut-ud-2.6-200830 | Raw text | 99.72 | 100.00 | 97.37 | 97.08 | 96.29 | 95.38 | 98.23 | 94.12 | 92.09 | 83.04 | 87.20 |
| english-partut-ud-2.6-200830 | Gold tokenization | β | β | 97.62 | 97.33 | 96.54 | 95.63 | 98.50 | 94.40 | 92.37 | 83.44 | 87.48 |
| estonian-edt-ud-2.6-200830 | Raw text | 99.96 | 91.56 | 97.65 | 98.25 | 96.44 | 95.19 | 95.34 | 88.75 | 86.18 | 80.12 | 79.65 |
| estonian-edt-ud-2.6-200830 | Gold tokenization | β | β | 97.75 | 98.29 | 96.48 | 95.28 | 95.40 | 89.66 | 87.06 | 80.93 | 80.44 |
| estonian-ewt-ud-2.6-200830 | Raw text | 98.96 | 70.09 | 95.00 | 96.30 | 93.74 | 91.31 | 93.81 | 81.07 | 77.55 | 69.14 | 70.69 |
| estonian-ewt-ud-2.6-200830 | Gold tokenization | β | β | 96.22 | 97.37 | 94.65 | 92.37 | 94.83 | 86.37 | 82.55 | 73.03 | 74.39 |
| finnish-tdt-ud-2.6-200830 | Raw text | 99.70 | 88.64 | 97.63 | 98.25 | 96.05 | 95.11 | 92.06 | 90.11 | 88.10 | 82.04 | 77.91 |
| finnish-tdt-ud-2.6-200830 | Gold tokenization | β | β | 97.97 | 98.56 | 96.37 | 95.48 | 92.38 | 91.69 | 89.63 | 83.30 | 79.18 |
| finnish-ftb-ud-2.6-200830 | Raw text | 99.91 | 86.84 | 96.52 | 95.08 | 96.72 | 93.82 | 95.73 | 89.93 | 87.32 | 80.13 | 80.74 |
| finnish-ftb-ud-2.6-200830 | Gold tokenization | β | β | 96.85 | 95.31 | 96.87 | 94.16 | 95.83 | 91.99 | 89.34 | 82.64 | 83.05 |
| french-gsd-ud-2.6-200830 | Raw text | 98.87 | 94.67 | 97.23 | 98.86 | 96.65 | 96.00 | 97.69 | 92.77 | 90.82 | 83.14 | 86.08 |
| french-gsd-ud-2.6-200830 | Gold tokenization | β | β | 98.29 | 99.99 | 97.63 | 96.94 | 98.80 | 94.46 | 92.63 | 84.72 | 87.21 |
| french-sequoia-ud-2.6-200830 | Raw text | 99.09 | 87.50 | 98.33 | β | 97.25 | 96.79 | 98.16 | 93.90 | 92.45 | 86.54 | 89.25 |
| french-sequoia-ud-2.6-200830 | Gold tokenization | β | β | 99.32 | β | 98.19 | 97.78 | 99.09 | 95.80 | 94.43 | 88.78 | 90.78 |
| french-partut-ud-2.6-200830 | Raw text | 99.42 | 100.00 | 97.28 | 96.93 | 94.17 | 93.63 | 95.59 | 94.71 | 92.71 | 80.18 | 83.34 |
| french-partut-ud-2.6-200830 | Gold tokenization | β | β | 97.89 | 97.54 | 94.74 | 94.20 | 96.20 | 95.47 | 93.62 | 81.20 | 84.28 |
| french-spoken-ud-2.6-200830 | Raw text | 99.06 | 21.15 | 96.49 | 96.44 | β | 93.98 | 97.48 | 79.23 | 74.91 | 64.48 | 66.67 |
| french-spoken-ud-2.6-200830 | Gold tokenization | β | β | 97.63 | 97.31 | β | 95.00 | 98.28 | 87.27 | 82.51 | 74.23 | 75.56 |
| galician-ctg-ud-2.6-200830 | Raw text | 99.22 | 97.22 | 97.30 | 97.07 | 99.05 | 96.71 | 98.07 | 85.45 | 83.07 | 72.03 | 76.75 |
| galician-ctg-ud-2.6-200830 | Gold tokenization | β | β | 98.04 | 97.79 | 99.83 | 97.43 | 98.82 | 87.22 | 84.73 | 74.05 | 78.78 |
| galician-treegal-ud-2.6-200830 | Raw text | 98.74 | 87.99 | 95.99 | 93.58 | 94.72 | 92.63 | 96.71 | 83.26 | 79.23 | 67.54 | 71.73 |
| galician-treegal-ud-2.6-200830 | Gold tokenization | β | β | 97.23 | 94.65 | 95.76 | 93.73 | 97.89 | 86.57 | 82.30 | 71.04 | 75.71 |
| german-hdt-ud-2.6-200830 | Raw text | 99.91 | 92.34 | 98.51 | 98.45 | 94.09 | 93.69 | 97.23 | 96.88 | 95.96 | 84.87 | 90.41 |
| german-hdt-ud-2.6-200830 | Gold tokenization | β | β | 98.62 | 98.57 | 94.21 | 93.81 | 97.32 | 97.57 | 96.67 | 85.53 | 91.10 |
| german-gsd-ud-2.6-200830 | Raw text | 99.58 | 80.90 | 94.39 | 97.51 | 91.14 | 85.97 | 96.58 | 87.06 | 82.93 | 62.33 | 74.97 |
| german-gsd-ud-2.6-200830 | Gold tokenization | β | β | 94.73 | 97.96 | 91.65 | 86.51 | 96.95 | 89.36 | 85.31 | 64.33 | 77.26 |
| gothic-proiel-ud-2.6-200830 | Raw text | 100.00 | 31.12 | 96.39 | 96.90 | 90.18 | 88.05 | 94.70 | 74.10 | 68.48 | 55.16 | 62.26 |
| gothic-proiel-ud-2.6-200830 | Gold tokenization | β | β | 96.81 | 97.26 | 91.12 | 89.28 | 94.77 | 83.73 | 77.93 | 65.37 | 70.85 |
| greek-gdt-ud-2.6-200830 | Raw text | 99.87 | 90.19 | 97.99 | 98.00 | 95.57 | 94.91 | 95.53 | 93.00 | 91.16 | 81.28 | 80.73 |
| greek-gdt-ud-2.6-200830 | Gold tokenization | β | β | 98.14 | 98.14 | 95.69 | 95.02 | 95.61 | 93.82 | 91.95 | 82.03 | 81.53 |
| hebrew-htb-ud-2.6-200830 | Raw text | 85.04 | 99.39 | 82.79 | 82.76 | 81.31 | 80.57 | 82.97 | 69.85 | 67.39 | 54.79 | 59.16 |
| hebrew-htb-ud-2.6-200830 | Gold tokenization | β | β | 97.48 | 97.48 | 96.03 | 95.36 | 97.23 | 91.83 | 89.25 | 78.52 | 81.02 |
| hindi-hdtb-ud-2.6-200830 | Raw text | 100.00 | 98.90 | 97.64 | 97.29 | 94.18 | 92.32 | 98.78 | 95.32 | 92.37 | 79.24 | 87.69 |
| hindi-hdtb-ud-2.6-200830 | Gold tokenization | β | β | 97.65 | 97.29 | 94.21 | 92.35 | 98.78 | 95.44 | 92.49 | 79.41 | 87.84 |
| hungarian-szeged-ud-2.6-200830 | Raw text | 99.85 | 95.89 | 96.77 | β | 94.32 | 93.51 | 94.97 | 87.78 | 84.24 | 74.80 | 77.84 |
| hungarian-szeged-ud-2.6-200830 | Gold tokenization | β | β | 96.87 | β | 94.45 | 93.61 | 95.09 | 88.28 | 84.73 | 75.27 | 78.26 |
| indonesian-gsd-ud-2.6-200830 | Raw text | 100.00 | 94.13 | 93.89 | 94.28 | 95.55 | 89.00 | 99.61 | 86.07 | 79.97 | 69.25 | 77.74 |
| indonesian-gsd-ud-2.6-200830 | Gold tokenization | β | β | 93.90 | 94.26 | 95.52 | 88.98 | 99.61 | 86.32 | 80.18 | 69.51 | 78.00 |
| irish-idt-ud-2.6-200830 | Raw text | 99.71 | 97.36 | 94.35 | 94.30 | 73.43 | 70.38 | 93.18 | 84.47 | 77.88 | 40.78 | 65.74 |
| irish-idt-ud-2.6-200830 | Gold tokenization | β | β | 94.59 | 94.60 | 73.65 | 70.63 | 93.41 | 84.98 | 78.30 | 40.94 | 65.87 |
| italian-isdt-ud-2.6-200830 | Raw text | 99.84 | 98.76 | 98.52 | 98.44 | 98.23 | 97.66 | 98.65 | 94.77 | 93.12 | 86.91 | 87.85 |
| italian-isdt-ud-2.6-200830 | Gold tokenization | β | β | 98.68 | 98.60 | 98.38 | 97.81 | 98.81 | 95.07 | 93.44 | 87.20 | 88.19 |
| italian-partut-ud-2.6-200830 | Raw text | 99.73 | 100.00 | 98.41 | 98.52 | 98.27 | 97.77 | 98.74 | 96.07 | 93.90 | 87.45 | 88.95 |
| italian-partut-ud-2.6-200830 | Gold tokenization | β | β | 98.54 | 98.65 | 98.38 | 97.88 | 98.93 | 96.18 | 93.98 | 87.48 | 89.15 |
| italian-postwita-ud-2.6-200830 | Raw text | 99.47 | 30.49 | 96.53 | 96.28 | 96.43 | 94.89 | 96.76 | 80.97 | 76.94 | 65.79 | 67.44 |
| italian-postwita-ud-2.6-200830 | Gold tokenization | β | β | 97.06 | 96.79 | 96.89 | 95.41 | 97.18 | 88.04 | 83.76 | 75.23 | 76.98 |
| italian-twittiro-ud-2.6-200830 | Raw text | 99.06 | 36.80 | 95.99 | 95.86 | 95.22 | 93.37 | 94.68 | 81.69 | 77.38 | 64.34 | 65.32 |
| italian-twittiro-ud-2.6-200830 | Gold tokenization | β | β | 97.01 | 96.77 | 96.14 | 94.42 | 95.50 | 87.84 | 83.43 | 71.64 | 72.68 |
| italian-vit-ud-2.6-200830 | Raw text | 99.69 | 94.69 | 97.86 | 97.07 | 97.38 | 95.76 | 98.64 | 92.03 | 89.20 | 80.39 | 83.83 |
| italian-vit-ud-2.6-200830 | Gold tokenization | β | β | 98.16 | 97.49 | 97.66 | 96.16 | 98.92 | 92.77 | 89.91 | 81.15 | 84.53 |
| japanese-gsd-ud-2.6-200830 | Raw text | 95.34 | 94.61 | 93.67 | 93.56 | 95.32 | 92.74 | 95.02 | 85.11 | 84.01 | 76.23 | 77.83 |
| japanese-gsd-ud-2.6-200830 | Gold tokenization | β | β | 98.03 | 97.71 | 99.99 | 96.83 | 99.61 | 94.73 | 93.41 | 87.64 | 89.28 |
| korean-kaist-ud-2.6-200830 | Raw text | 99.95 | 100.00 | 95.89 | 87.82 | β | 87.62 | 94.23 | 89.41 | 87.58 | 82.32 | 80.34 |
| korean-kaist-ud-2.6-200830 | Gold tokenization | β | β | 95.94 | 87.85 | β | 87.66 | 94.27 | 89.51 | 87.67 | 82.42 | 80.42 |
| korean-gsd-ud-2.6-200830 | Raw text | 99.87 | 93.93 | 96.61 | 90.19 | 99.69 | 88.03 | 93.51 | 88.68 | 85.04 | 80.93 | 77.36 |
| korean-gsd-ud-2.6-200830 | Gold tokenization | β | β | 96.74 | 90.32 | 99.82 | 88.16 | 93.64 | 89.50 | 85.84 | 81.76 | 78.14 |
| latin-ittb-ud-2.6-200830 | Raw text | 99.99 | 92.44 | 98.54 | 96.35 | 96.92 | 95.12 | 98.94 | 90.31 | 88.16 | 82.19 | 85.37 |
| latin-ittb-ud-2.6-200830 | Gold tokenization | β | β | 98.52 | 96.37 | 96.92 | 95.11 | 98.93 | 91.24 | 89.07 | 82.62 | 85.88 |
| latin-llct-ud-2.6-200830 | Raw text | 100.00 | 99.49 | 99.60 | 97.13 | 97.11 | 96.63 | 97.68 | 95.48 | 94.35 | 89.31 | 90.44 |
| latin-llct-ud-2.6-200830 | Gold tokenization | β | β | 99.60 | 97.14 | 97.11 | 96.63 | 97.68 | 95.54 | 94.40 | 89.40 | 90.53 |
| latin-proiel-ud-2.6-200830 | Raw text | 99.87 | 36.81 | 96.67 | 96.81 | 90.71 | 89.59 | 96.16 | 74.44 | 69.97 | 57.51 | 64.96 |
| latin-proiel-ud-2.6-200830 | Gold tokenization | β | β | 97.07 | 97.16 | 91.53 | 90.52 | 96.42 | 83.78 | 79.04 | 67.58 | 73.88 |
| latin-perseus-ud-2.6-200830 | Raw text | 100.00 | 98.46 | 91.65 | 81.18 | 86.33 | 78.75 | 88.05 | 78.09 | 68.97 | 52.82 | 56.03 |
| latin-perseus-ud-2.6-200830 | Gold tokenization | β | β | 91.64 | 81.17 | 86.33 | 78.74 | 88.04 | 78.21 | 69.07 | 52.84 | 55.99 |
| latvian-lvtb-ud-2.6-200830 | Raw text | 99.32 | 98.74 | 96.28 | 89.64 | 93.79 | 88.84 | 95.81 | 88.31 | 85.26 | 75.23 | 79.56 |
| latvian-lvtb-ud-2.6-200830 | Gold tokenization | β | β | 96.92 | 90.24 | 94.40 | 89.43 | 96.45 | 89.33 | 86.23 | 76.29 | 80.60 |
| lithuanian-alksnis-ud-2.6-200830 | Raw text | 99.91 | 87.87 | 95.97 | 90.37 | 91.07 | 89.41 | 93.61 | 82.54 | 78.70 | 67.95 | 71.30 |
| lithuanian-alksnis-ud-2.6-200830 | Gold tokenization | β | β | 96.04 | 90.40 | 91.18 | 89.49 | 93.70 | 83.93 | 80.08 | 69.02 | 72.43 |
| lithuanian-hse-ud-2.6-200830 | Raw text | 97.30 | 97.30 | 89.66 | 89.28 | 81.45 | 77.07 | 87.98 | 70.92 | 62.53 | 44.26 | 53.76 |
| lithuanian-hse-ud-2.6-200830 | Gold tokenization | β | β | 91.23 | 91.32 | 83.21 | 78.40 | 90.28 | 73.77 | 64.53 | 45.25 | 54.68 |
| maltese-mudt-ud-2.6-200830 | Raw text | 99.84 | 86.29 | 95.77 | 95.66 | β | 95.30 | β | 84.76 | 79.76 | 68.39 | 72.24 |
| maltese-mudt-ud-2.6-200830 | Gold tokenization | β | β | 95.88 | 95.77 | β | 95.40 | β | 85.46 | 80.38 | 68.69 | 72.66 |
| marathi-ufal-ud-2.6-200830 | Raw text | 90.25 | 92.63 | 78.50 | β | 65.25 | 61.50 | 80.00 | 61.25 | 53.50 | 31.73 | 40.92 |
| marathi-ufal-ud-2.6-200830 | Gold tokenization | β | β | 84.22 | β | 68.69 | 63.83 | 80.10 | 70.39 | 60.92 | 31.95 | 42.32 |
| naija-nsc-ud-2.6-200830 | Raw text | 100.00 | 99.56 | 98.14 | β | 99.16 | 97.77 | 99.27 | 92.46 | 89.81 | 84.18 | 86.20 |
| naija-nsc-ud-2.6-200830 | Gold tokenization | β | β | 98.14 | β | 99.16 | 97.77 | 99.27 | 92.50 | 89.84 | 84.25 | 86.26 |
| north_sami-giella-ud-2.6-200830 | Raw text | 99.87 | 98.79 | 92.35 | 93.57 | 89.40 | 85.61 | 86.85 | 76.66 | 71.84 | 60.71 | 58.95 |
| north_sami-giella-ud-2.6-200830 | Gold tokenization | β | β | 92.47 | 93.70 | 89.56 | 85.75 | 86.96 | 76.97 | 72.16 | 60.95 | 59.19 |
| norwegian-bokmaal-ud-2.6-200830 | Raw text | 99.83 | 95.63 | 98.37 | β | 97.52 | 96.86 | 98.55 | 93.74 | 92.26 | 87.03 | 88.76 |
| norwegian-bokmaal-ud-2.6-200830 | Gold tokenization | β | β | 98.57 | β | 97.71 | 97.05 | 98.75 | 94.48 | 93.00 | 87.67 | 89.43 |
| norwegian-nynorsk-ud-2.6-200830 | Raw text | 99.91 | 94.11 | 98.36 | β | 97.38 | 96.67 | 98.37 | 93.86 | 92.11 | 86.07 | 88.11 |
| norwegian-nynorsk-ud-2.6-200830 | Gold tokenization | β | β | 98.50 | β | 97.51 | 96.80 | 98.50 | 94.66 | 92.93 | 86.95 | 89.01 |
| norwegian-nynorsklia-ud-2.6-200830 | Raw text | 99.91 | 99.53 | 96.45 | β | 95.71 | 93.62 | 98.05 | 80.90 | 76.53 | 65.74 | 69.55 |
| norwegian-nynorsklia-ud-2.6-200830 | Gold tokenization | β | β | 96.55 | β | 95.79 | 93.72 | 98.14 | 81.15 | 76.76 | 65.94 | 69.80 |
| old_church_slavonic-proiel-ud-2.6-200830 | Raw text | 100.00 | 41.43 | 96.58 | 96.83 | 90.44 | 89.17 | 93.19 | 77.42 | 73.57 | 63.51 | 68.53 |
| old_church_slavonic-proiel-ud-2.6-200830 | Gold tokenization | β | β | 96.89 | 97.09 | 91.22 | 89.97 | 93.20 | 87.95 | 83.81 | 73.92 | 77.26 |
| old_french-srcmf-ud-2.6-200830 | Raw text | 99.93 | 100.00 | 96.40 | 96.27 | 97.80 | 95.58 | β | 92.28 | 87.74 | 81.08 | 84.17 |
| old_french-srcmf-ud-2.6-200830 | Gold tokenization | β | β | 96.47 | 96.33 | 97.86 | 95.64 | β | 92.36 | 87.81 | 81.17 | 84.26 |
| old_russian-torot-ud-2.6-200830 | Raw text | 100.00 | 29.60 | 94.33 | 94.39 | 87.51 | 85.16 | 85.82 | 70.66 | 65.18 | 51.26 | 53.18 |
| old_russian-torot-ud-2.6-200830 | Gold tokenization | β | β | 94.93 | 94.99 | 88.44 | 86.35 | 85.77 | 83.15 | 77.17 | 63.78 | 62.66 |
| old_russian-rnc-ud-2.6-200830 | Raw text | 98.15 | 85.46 | 91.80 | 87.74 | 75.83 | 66.63 | 74.94 | 63.08 | 57.53 | 33.85 | 35.04 |
| old_russian-rnc-ud-2.6-200830 | Gold tokenization | β | β | 93.34 | 89.43 | 77.09 | 67.76 | 76.13 | 66.86 | 60.73 | 36.05 | 37.07 |
| persian-seraji-ud-2.6-200830 | Raw text | 99.65 | 98.75 | 97.69 | 97.66 | 97.75 | 97.29 | 96.67 | 91.09 | 88.15 | 83.43 | 82.26 |
| persian-seraji-ud-2.6-200830 | Gold tokenization | β | β | 97.98 | 97.97 | 98.07 | 97.60 | 96.94 | 91.74 | 88.76 | 84.00 | 82.82 |
| polish-pdb-ud-2.6-200830 | Raw text | 99.85 | 97.33 | 98.88 | 95.73 | 95.84 | 95.03 | 98.05 | 94.02 | 92.01 | 84.93 | 88.08 |
| polish-pdb-ud-2.6-200830 | Gold tokenization | β | β | 99.04 | 95.88 | 95.99 | 95.18 | 98.19 | 94.51 | 92.50 | 85.36 | 88.52 |
| polish-lfg-ud-2.6-200830 | Raw text | 99.85 | 99.65 | 98.92 | 95.99 | 96.51 | 95.06 | 98.27 | 96.89 | 95.52 | 89.73 | 92.45 |
| polish-lfg-ud-2.6-200830 | Gold tokenization | β | β | 99.09 | 96.18 | 96.70 | 95.25 | 98.41 | 97.29 | 95.91 | 90.12 | 92.77 |
| portuguese-gsd-ud-2.6-200830 | Raw text | 99.84 | 97.50 | 98.53 | 98.52 | 99.71 | 98.43 | 99.33 | 94.57 | 93.47 | 88.69 | 90.02 |
| portuguese-gsd-ud-2.6-200830 | Gold tokenization | β | β | 98.69 | 98.69 | 99.87 | 98.59 | 99.49 | 94.94 | 93.82 | 89.11 | 90.36 |
| portuguese-bosque-ud-2.6-200830 | Raw text | 99.55 | 90.64 | 97.19 | β | 96.17 | 94.79 | 97.98 | 92.32 | 89.72 | 79.29 | 84.22 |
| portuguese-bosque-ud-2.6-200830 | Gold tokenization | β | β | 97.60 | β | 96.49 | 95.11 | 98.42 | 93.53 | 90.80 | 80.42 | 85.51 |
| romanian-rrt-ud-2.6-200830 | Raw text | 99.69 | 95.28 | 97.79 | 97.18 | 97.32 | 96.81 | 98.20 | 91.83 | 87.56 | 80.00 | 82.17 |
| romanian-rrt-ud-2.6-200830 | Gold tokenization | β | β | 98.08 | 97.44 | 97.60 | 97.08 | 98.49 | 92.74 | 88.38 | 80.82 | 82.88 |
| romanian-nonstandard-ud-2.6-200830 | Raw text | 98.35 | 96.73 | 95.61 | 91.38 | 90.03 | 88.67 | 94.23 | 88.89 | 84.47 | 67.59 | 75.81 |
| romanian-nonstandard-ud-2.6-200830 | Gold tokenization | β | β | 97.21 | 92.90 | 91.53 | 90.13 | 95.74 | 91.00 | 86.49 | 69.53 | 77.28 |
| russian-syntagrus-ud-2.6-200830 | Raw text | 99.60 | 98.80 | 98.86 | β | 97.60 | 97.38 | 98.33 | 94.22 | 92.97 | 89.27 | 90.35 |
| russian-syntagrus-ud-2.6-200830 | Gold tokenization | β | β | 99.27 | β | 97.98 | 97.76 | 98.68 | 94.99 | 93.72 | 89.90 | 90.95 |
| russian-gsd-ud-2.6-200830 | Raw text | 99.50 | 96.22 | 98.03 | 97.51 | 94.76 | 93.60 | 96.89 | 91.66 | 88.38 | 80.67 | 84.18 |
| russian-gsd-ud-2.6-200830 | Gold tokenization | β | β | 98.49 | 97.98 | 95.17 | 93.97 | 97.27 | 92.77 | 89.43 | 81.44 | 85.05 |
| russian-taiga-ud-2.6-200830 | Raw text | 97.16 | 82.69 | 94.13 | 95.72 | 90.01 | 87.50 | 93.05 | 81.17 | 76.99 | 65.28 | 69.94 |
| russian-taiga-ud-2.6-200830 | Gold tokenization | β | β | 96.47 | 98.56 | 92.72 | 89.87 | 95.68 | 85.57 | 80.81 | 68.93 | 73.90 |
| sanskrit-vedic-ud-2.6-200830 | Raw text | 100.00 | 27.18 | 89.50 | β | 81.72 | 77.12 | 87.11 | 60.79 | 49.75 | 41.65 | 44.67 |
| sanskrit-vedic-ud-2.6-200830 | Gold tokenization | β | β | 90.01 | β | 83.11 | 78.58 | 87.24 | 73.34 | 61.55 | 51.87 | 54.91 |
| scottish_gaelic-arcosg-ud-2.6-200830 | Raw text | 99.58 | 55.57 | 93.63 | 87.07 | 89.78 | 85.43 | 95.41 | 77.66 | 71.86 | 55.15 | 60.51 |
| scottish_gaelic-arcosg-ud-2.6-200830 | Gold tokenization | β | β | 94.26 | 87.84 | 90.23 | 86.30 | 95.85 | 83.77 | 77.61 | 62.05 | 68.26 |
| serbian-set-ud-2.6-200830 | Raw text | 99.99 | 93.00 | 98.98 | 95.75 | 95.92 | 95.35 | 97.82 | 93.66 | 91.18 | 83.18 | 86.80 |
| serbian-set-ud-2.6-200830 | Gold tokenization | β | β | 99.01 | 95.78 | 95.94 | 95.39 | 97.83 | 94.33 | 91.82 | 83.84 | 87.45 |
| slovak-snk-ud-2.6-200830 | Raw text | 100.00 | 85.28 | 97.19 | 87.79 | 92.66 | 86.71 | 96.52 | 91.71 | 89.60 | 78.75 | 84.54 |
| slovak-snk-ud-2.6-200830 | Gold tokenization | β | β | 97.30 | 88.06 | 92.84 | 86.98 | 96.60 | 93.68 | 91.57 | 80.55 | 86.59 |
| slovenian-ssj-ud-2.6-200830 | Raw text | 97.99 | 67.98 | 96.93 | 94.35 | 94.56 | 93.95 | 96.59 | 88.09 | 86.65 | 80.90 | 83.58 |
| slovenian-ssj-ud-2.6-200830 | Gold tokenization | β | β | 98.86 | 96.44 | 96.69 | 96.01 | 98.54 | 94.41 | 92.96 | 86.68 | 89.30 |
| slovenian-sst-ud-2.6-200830 | Raw text | 99.85 | 23.14 | 94.70 | 92.70 | 92.52 | 89.74 | 97.14 | 64.23 | 59.57 | 49.25 | 52.95 |
| slovenian-sst-ud-2.6-200830 | Gold tokenization | β | β | 95.71 | 93.11 | 92.94 | 90.90 | 97.46 | 77.81 | 72.24 | 62.71 | 67.18 |
| spanish-ancora-ud-2.6-200830 | Raw text | 99.95 | 98.32 | 99.09 | 99.02 | 98.87 | 98.33 | 99.36 | 93.62 | 91.78 | 86.82 | 88.06 |
| spanish-ancora-ud-2.6-200830 | Gold tokenization | β | β | 99.14 | 99.06 | 98.91 | 98.37 | 99.40 | 93.83 | 91.97 | 87.01 | 88.24 |
| spanish-gsd-ud-2.6-200830 | Raw text | 99.76 | 94.54 | 97.17 | β | 97.05 | 95.32 | 98.80 | 92.00 | 89.70 | 79.23 | 84.49 |
| spanish-gsd-ud-2.6-200830 | Gold tokenization | β | β | 97.40 | β | 97.27 | 95.54 | 99.02 | 92.73 | 90.38 | 79.93 | 85.13 |
| swedish-talbanken-ud-2.6-200830 | Raw text | 99.89 | 96.13 | 98.41 | 97.26 | 97.33 | 96.46 | 98.19 | 91.99 | 89.68 | 83.63 | 85.82 |
| swedish-talbanken-ud-2.6-200830 | Gold tokenization | β | β | 98.51 | 97.38 | 97.44 | 96.57 | 98.30 | 92.46 | 90.14 | 84.12 | 86.33 |
| swedish-lines-ud-2.6-200830 | Raw text | 99.96 | 87.20 | 97.71 | 95.47 | 90.89 | 88.10 | 97.76 | 89.14 | 85.80 | 71.44 | 81.67 |
| swedish-lines-ud-2.6-200830 | Gold tokenization | β | β | 97.75 | 95.48 | 90.91 | 88.09 | 97.79 | 89.91 | 86.52 | 72.13 | 82.48 |
| tamil-ttb-ud-2.6-200830 | Raw text | 94.51 | 97.52 | 88.39 | 82.92 | 85.30 | 82.11 | 89.15 | 70.28 | 64.91 | 54.93 | 58.46 |
| tamil-ttb-ud-2.6-200830 | Gold tokenization | β | β | 93.36 | 87.28 | 90.10 | 86.22 | 93.97 | 78.03 | 71.79 | 61.09 | 64.80 |
| telugu-mtg-ud-2.6-200830 | Raw text | 99.58 | 96.62 | 93.63 | 93.63 | 98.48 | 93.63 | β | 90.17 | 83.52 | 76.00 | 79.62 |
| telugu-mtg-ud-2.6-200830 | Gold tokenization | β | β | 94.04 | 94.04 | 98.89 | 94.04 | β | 91.12 | 84.47 | 76.84 | 80.46 |
| turkish-imst-ud-2.6-200830 | Raw text | 98.30 | 96.97 | 94.48 | 93.69 | 92.06 | 89.95 | 94.41 | 72.63 | 66.80 | 58.31 | 61.57 |
| turkish-imst-ud-2.6-200830 | Gold tokenization | β | β | 96.10 | 95.32 | 93.66 | 91.50 | 96.00 | 76.10 | 69.93 | 60.33 | 63.83 |
| ukrainian-iu-ud-2.6-200830 | Raw text | 99.81 | 96.61 | 97.89 | 94.22 | 94.18 | 93.13 | 97.39 | 90.59 | 88.24 | 78.76 | 83.19 |
| ukrainian-iu-ud-2.6-200830 | Gold tokenization | β | β | 98.10 | 94.42 | 94.34 | 93.30 | 97.56 | 91.11 | 88.75 | 79.11 | 83.59 |
| urdu-udtb-ud-2.6-200830 | Raw text | 100.00 | 98.31 | 94.10 | 92.27 | 82.89 | 78.41 | 97.38 | 88.27 | 82.63 | 56.79 | 74.77 |
| urdu-udtb-ud-2.6-200830 | Gold tokenization | β | β | 94.08 | 92.26 | 82.92 | 78.43 | 97.39 | 88.37 | 82.74 | 56.90 | 74.92 |
| uyghur-udt-ud-2.6-200830 | Raw text | 99.54 | 81.81 | 89.24 | 91.70 | 88.47 | 80.04 | 94.76 | 76.58 | 64.72 | 46.67 | 55.08 |
| uyghur-udt-ud-2.6-200830 | Gold tokenization | β | β | 89.67 | 92.21 | 88.92 | 80.47 | 95.27 | 78.39 | 66.27 | 47.53 | 56.23 |
| vietnamese-vtb-ud-2.6-200830 | Raw text | 85.37 | 93.46 | 78.19 | 76.69 | 85.11 | 76.53 | 85.15 | 52.80 | 47.90 | 41.56 | 44.31 |
| vietnamese-vtb-ud-2.6-200830 | Gold tokenization | β | β | 90.56 | 88.69 | 99.72 | 88.47 | 99.58 | 72.63 | 65.26 | 58.85 | 62.42 |
| welsh-ccg-ud-2.6-200830 | Raw text | 99.42 | 96.28 | 94.02 | 92.96 | 89.04 | 86.39 | 92.88 | 85.79 | 79.16 | 60.98 | 66.81 |
| welsh-ccg-ud-2.6-200830 | Gold tokenization | β | β | 94.54 | 93.51 | 89.52 | 86.83 | 93.46 | 87.04 | 80.35 | 62.14 | 68.05 |
| wolof-wtb-ud-2.6-200830 | Raw text | 99.23 | 91.95 | 94.25 | 94.12 | 93.37 | 91.19 | 95.22 | 83.79 | 78.59 | 66.50 | 70.09 |
| wolof-wtb-ud-2.6-200830 | Gold tokenization | β | β | 95.19 | 95.03 | 94.22 | 92.10 | 95.97 | 85.98 | 80.75 | 68.61 | 72.08 |
|