Update README.md
Browse files
README.md
CHANGED
@@ -38,11 +38,11 @@ In our recent evaluation, we used several multilingual benchmarks to assess our
|
|
38 |
| Multilingual Benchmark | Language | Dynamo 8B | Mistral 7B | Llama2 13B | Bloom 7B | PolyLM 13B |
|
39 |
|------------------------|----------|-----------|------------|------------|----------|------------|
|
40 |
| PAWS | German | **0.516** | 0.363 | 0.377 | 0.502 | 0.390 |
|
41 |
-
|
|
42 |
-
|
|
43 |
-
|
|
44 |
| XCOPA | Italian | **0.710** | 0.63 | 0.692 | 0.516 | 0.644 |
|
45 |
-
|
|
46 |
| xstorycloze | Spanish | **0.645** | 0.632 | 0.622 | 0.639 | **0.642** |
|
47 |
|
48 |
|
|
|
38 |
| Multilingual Benchmark | Language | Dynamo 8B | Mistral 7B | Llama2 13B | Bloom 7B | PolyLM 13B |
|
39 |
|------------------------|----------|-----------|------------|------------|----------|------------|
|
40 |
| PAWS | German | **0.516** | 0.363 | 0.377 | 0.502 | 0.390 |
|
41 |
+
| PAWS | English | **0.497** | 0.311 | 0.336 | 0.422 | 0.413 |
|
42 |
+
| PAWS | Spanish | **0.515** | 0.339 | 0.422 | 0.424 | 0.452 |
|
43 |
+
| PAWS | Korean | **0.552** | 0.422 | 0.534 | **0.551** | 0.544 |
|
44 |
| XCOPA | Italian | **0.710** | 0.63 | 0.692 | 0.516 | 0.644 |
|
45 |
+
| XCOPA | Turkish | **0.672** | 0.562 | 0.550 | 0.520 | 0.574 |
|
46 |
| xstorycloze | Spanish | **0.645** | 0.632 | 0.622 | 0.639 | **0.642** |
|
47 |
|
48 |
|