Update README.md
Browse files
README.md
CHANGED
@@ -9,15 +9,13 @@ datasets:
|
|
9 |
|
10 |
## Model Summary
|
11 |
|
12 |
-
FuxiTranyu-8B is
|
13 |
-
FuxiTranyu-8B was trained on 600B tokens with a much more smooth distribution across languages.
|
14 |
|
15 |
-
|
16 |
-
And also cover 16 programming languages: Java, JavaScript, Python, PHP, C, C++, C#, TypeScript, Go, SQL, Rust, Ruby, Scala, Lua, Assembly, and Visual Basic.
|
17 |
|
18 |
FuxiTranyu-8B-DPO is trained using DPO with the UltraFeedback dataset, based on the [FuxiTranyu-8B](https://huggingface.co/TJUNLP/FuxiTranyu-8B) model.
|
19 |
|
20 |
-
More details can be found
|
21 |
|
22 |
We also provide the instruction fine-tuned version at [here](https://huggingface.co/TJUNLP/FuxiTranyu-8B-SFT).
|
23 |
## Usage
|
|
|
9 |
|
10 |
## Model Summary
|
11 |
|
12 |
+
FuxiTranyu-8B is an **open-source** **multilingual large language model** trained from scratch, with a specific focus on the multilinguality. It is trained on 600B tokens with a balanced data distribution across languages, exhibiting remarkable multilingual performance compared to previous multilingual LLMs like BLOOM-7B, PolyLM-13B.
|
|
|
13 |
|
14 |
+
FuxiTranyu supports 43 natural languages (Arabic, Bengali, Bulgarian, Burmese, Catalan, Chinese, Czech, Dutch, English, Filipino, Finnish, French, German, Greek, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Kazakh, Khmer, Korean, Kurdish, Kyrgyz, Lao, Malay, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Swedish, Tamil, Tajik, Thai, Turkish, Turkmen, Ukrainian, Urdu, Uzbek, and Vietnamese) and cover 16 programming languages (Java, JavaScript, Python, PHP, C, C++, C#, TypeScript, Go, SQL, Rust, Ruby, Scala, Lua, Assembly, and Visual Basic).
|
|
|
15 |
|
16 |
FuxiTranyu-8B-DPO is trained using DPO with the UltraFeedback dataset, based on the [FuxiTranyu-8B](https://huggingface.co/TJUNLP/FuxiTranyu-8B) model.
|
17 |
|
18 |
+
More details on the data collection & processing, pretraining and fine-tuning of FuxiTranyu can be found in the technical report.
|
19 |
|
20 |
We also provide the instruction fine-tuned version at [here](https://huggingface.co/TJUNLP/FuxiTranyu-8B-SFT).
|
21 |
## Usage
|