Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,43 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
4 |
|
5 |
|
@@ -373,16 +411,33 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
|
|
373 |
|
374 |
### English
|
375 |
|
376 |
-
| | Bleu
|
377 |
|:---------------------------------|-------:|------:|-------:|--------:|-------------:|---------:|----------:|-------------:|
|
378 |
| **EN-XX** | | | | | | | | |
|
379 |
| SalamandraTA-7b-instruct | **36.29** | **50.62** | 63.3 | **0.89** | **0.85** | **0.79** | **1.02** | **0.94** |
|
380 |
| MADLAD400-7B | 35.73 | 51.87 | **63.46** | 0.88 | **0.85** | **0.79** | 1.16 | 1.1 |
|
381 |
| SalamandraTA-7b-base | 34.99 | 52.64 | 62.58 | 0.87 | 0.84 | 0.77 | 1.45 | 1.23 |
|
382 |
| **XX-EN** | | | | | | | | |
|
383 |
-
| SalamandraTA-7b-instruct | **44.69** | **41.72** | 68.17 | **0.89** |
|
384 |
-
| SalamandraTA-7b-base | 44.12 | 43 | **68.43** | **0.89** |
|
385 |
-
| MADLAD400-7B | 43.2 | 43.33 | 67.98 | 0.89 | 0.86 | 0.8 | 1.13 | 1.15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
386 |
|
387 |
## Ethical Considerations and Limitations
|
388 |
|
@@ -422,6 +477,4 @@ including those governing the use of Artificial Intelligence.
|
|
422 |
The Barcelona Supercomputing Center, as the owner and creator of the model, shall not be held liable for any outcomes resulting from third-party use.
|
423 |
|
424 |
### License
|
425 |
-
[Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)
|
426 |
-
|
427 |
-
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- bg
|
5 |
+
- ca
|
6 |
+
- cs
|
7 |
+
- cy
|
8 |
+
- da
|
9 |
+
- de
|
10 |
+
- el
|
11 |
+
- en
|
12 |
+
- es
|
13 |
+
- et
|
14 |
+
- eu
|
15 |
+
- fi
|
16 |
+
- fr
|
17 |
+
- ga
|
18 |
+
- gl
|
19 |
+
- hr
|
20 |
+
- hu
|
21 |
+
- it
|
22 |
+
- lt
|
23 |
+
- lv
|
24 |
+
- mt
|
25 |
+
- nl
|
26 |
+
- nb
|
27 |
+
- 'no'
|
28 |
+
- nn
|
29 |
+
- oc
|
30 |
+
- pl
|
31 |
+
- pt
|
32 |
+
- ro
|
33 |
+
- ru
|
34 |
+
- sl
|
35 |
+
- sk
|
36 |
+
- sr
|
37 |
+
- sv
|
38 |
+
- uk
|
39 |
+
- ast
|
40 |
+
- an
|
41 |
---
|
42 |
|
43 |
|
|
|
411 |
|
412 |
### English
|
413 |
|
414 |
+
| | Bleu↑ | Ter↓ | ChrF↑ | Comet↑ | Comet-kiwi↑ | Bleurt↑ | MetricX↓ | MetricX-QE↓ |
|
415 |
|:---------------------------------|-------:|------:|-------:|--------:|-------------:|---------:|----------:|-------------:|
|
416 |
| **EN-XX** | | | | | | | | |
|
417 |
| SalamandraTA-7b-instruct | **36.29** | **50.62** | 63.3 | **0.89** | **0.85** | **0.79** | **1.02** | **0.94** |
|
418 |
| MADLAD400-7B | 35.73 | 51.87 | **63.46** | 0.88 | **0.85** | **0.79** | 1.16 | 1.1 |
|
419 |
| SalamandraTA-7b-base | 34.99 | 52.64 | 62.58 | 0.87 | 0.84 | 0.77 | 1.45 | 1.23 |
|
420 |
| **XX-EN** | | | | | | | | |
|
421 |
+
| SalamandraTA-7b-instruct | **44.69** | **41.72** | 68.17 | **0.89** | 0.85 | **0.8** | **1.09** | **1.11** |
|
422 |
+
| SalamandraTA-7b-base | 44.12 | 43 | **68.43** | **0.89** | 0.85 | **0.8** | 1.13 | 1.22 |
|
423 |
+
| MADLAD400-7B | 43.2 | 43.33 | 67.98 | **0.89** | **0.86** | 0.8 | 1.13 | 1.15 |
|
424 |
+
|
425 |
+
|
426 |
+
### Spanish
|
427 |
+
|
428 |
+
|
429 |
+
| | Bleu↑ | Ter↓ | ChrF↑ | Comet↑ | Comet-kiwi↑ | Bleurt↑ | MetricX↓ | MetricX-QE↓ |
|
430 |
+
|:---------------------------------|-------:|------:|-------:|--------:|-------------:|---------:|----------:|-------------:|
|
431 |
+
| **ES-XX** | | | | | | | | |
|
432 |
+
| SalamandraTA-7b-instruct | **23.67** | **65.71** | 53.55 | **0.87** | 0.82 | **0.75** | **1.04** | **1.05** |
|
433 |
+
| MADLAD400-7B | 22.48 | 68.91 | **53.93** | 0.86 | **0.83** | **0.75** | 1.09 | 1.14 |
|
434 |
+
| SalamandraTA-7b-base | 21.63 | 70.08 | 52.98 | 0.86 | **0.83** | 0.74 | 1.24 | 1.12 |
|
435 |
+
| **XX-ES** | | | | | | | | |
|
436 |
+
| SalamandraTA-7b-instruct | **25.56** | **62.51** | 52.69 | **0.85** | 0.83 | 0.73 | **0.94** | **1.33** |
|
437 |
+
| MADLAD400-7B | 24.85 | 61.82 | **53** | **0.85** | **0.84** | **0.74** | 1.05 | 1.5 |
|
438 |
+
| SalamandraTA-7b-base | 24.71 | 62.33 | 52.96 | **0.85** | **0.84** | 0.73 | 1.06 | 1.37 |
|
439 |
+
|
440 |
+
|
441 |
|
442 |
## Ethical Considerations and Limitations
|
443 |
|
|
|
477 |
The Barcelona Supercomputing Center, as the owner and creator of the model, shall not be held liable for any outcomes resulting from third-party use.
|
478 |
|
479 |
### License
|
480 |
+
[Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)
|
|
|
|