Update README.md
Browse files
README.md
CHANGED
@@ -536,7 +536,7 @@ This section presents the evaluation metrics for Basque translation tasks.
|
|
536 |
|
537 |
### Low-Resource Languages of Spain
|
538 |
|
539 |
-
The tables below summarize the performance metrics for English, Spanish, and Catalan to Asturian, Aranese and Aragonese.
|
540 |
|
541 |
#### English-XX
|
542 |
|
@@ -559,14 +559,17 @@ The tables below summarize the performance metrics for English, Spanish, and Cat
|
|
559 |
|:---------------------------------|:---------|:---------|-------:|-------:|-------:|
|
560 |
| SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
|
561 |
| SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
|
|
|
562 |
| salamandraTA2B | es | ast | 16.68 | 77.29 | 49.46 |
|
563 |
| nllb-3.3B | es | ast | 11.85 | 100.86 | 40.27 |
|
564 |
| | | | | | |
|
565 |
| SalamandraTA-7b-base | es | arn | **29.19** | **71.85** | **49.42** |
|
|
|
566 |
| SalamandraTA-7b-instruct | es | arn | 26.82 | 74.04 | 47.55 |
|
567 |
| salamandraTA2B | es | arn | 25.41 | 74.71 | 47.33 |
|
568 |
| | | | | | |
|
569 |
-
|
|
|
|
570 |
| SalamandraTA-7b-instruct | es | arg | 47.54 | 36.57 | 72.38 |
|
571 |
| salamandraTA2B | es | arg | 44.57 | 37.93 | 71.32 |
|
572 |
|
@@ -582,6 +585,7 @@ The tables below summarize the performance metrics for English, Spanish, and Cat
|
|
582 |
| nllb-3.3B | ca | ast | 17.17 | 91.47 | 45.83 |
|
583 |
| | | | | | |
|
584 |
| SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
|
|
|
585 |
| SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
|
586 |
| salamandraTA2B | ca | arn | 15.37 | 82.76 | 40.53 |
|
587 |
| | | | | | |
|
|
|
536 |
|
537 |
### Low-Resource Languages of Spain
|
538 |
|
539 |
+
The tables below summarize the performance metrics for English, Spanish, and Catalan to Asturian, Aranese and Aragonese compared against [Transducens/IbRo-nllb](https://huggingface.co/Transducens/IbRo-nllb) [(Galiano Jimenez, et al.)](https://aclanthology.org/2024.wmt-1.85/).
|
540 |
|
541 |
#### English-XX
|
542 |
|
|
|
559 |
|:---------------------------------|:---------|:---------|-------:|-------:|-------:|
|
560 |
| SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
|
561 |
| SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
|
562 |
+
| Transducens/IbRo-nllb | es | ast | 16.79 | 76.36 | 50.89 |
|
563 |
| salamandraTA2B | es | ast | 16.68 | 77.29 | 49.46 |
|
564 |
| nllb-3.3B | es | ast | 11.85 | 100.86 | 40.27 |
|
565 |
| | | | | | |
|
566 |
| SalamandraTA-7b-base | es | arn | **29.19** | **71.85** | **49.42** |
|
567 |
+
| Transducens/IbRo-nllb | es | arn | 28.45 | 72.56 | 49.28 |
|
568 |
| SalamandraTA-7b-instruct | es | arn | 26.82 | 74.04 | 47.55 |
|
569 |
| salamandraTA2B | es | arn | 25.41 | 74.71 | 47.33 |
|
570 |
| | | | | | |
|
571 |
+
| Transducens/IbRo-nllb | es | arg | **59.75** | **28.01** | **78.73** |
|
572 |
+
| SalamandraTA-7b-base | es | arg | 53.96 | 31.51 | 76.08 |
|
573 |
| SalamandraTA-7b-instruct | es | arg | 47.54 | 36.57 | 72.38 |
|
574 |
| salamandraTA2B | es | arg | 44.57 | 37.93 | 71.32 |
|
575 |
|
|
|
585 |
| nllb-3.3B | ca | ast | 17.17 | 91.47 | 45.83 |
|
586 |
| | | | | | |
|
587 |
| SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
|
588 |
+
| Transducens/IbRo-nllb | ca | arn | 17.51 | 81.18 | 41.91 |
|
589 |
| SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
|
590 |
| salamandraTA2B | ca | arn | 15.37 | 82.76 | 40.53 |
|
591 |
| | | | | | |
|