Text Generation
Transformers
Safetensors
fuxitranyu
conversational
custom_code
hrsun15 commited on
Commit
0232e03
·
verified ·
1 Parent(s): e81641c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -9,15 +9,13 @@ datasets:
9
 
10
  ## Model Summary
11
 
12
- FuxiTranyu-8B is a completely open source large language model trained from scratch, with a specific focus on the multilinguality.
13
- FuxiTranyu-8B was trained on 600B tokens with a much more smooth distribution across languages.
14
 
15
- We cover 43 natural languages: Arabic, Bengali, Bulgarian, Burmese, Catalan, Chinese, Czech, Dutch, English, Filipino, Finnish, French, German, Greek, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Kazakh, Khmer, Korean, Kurdish, Kyrgyz, Lao, Malay, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Swedish, Tamil, Tajik, Thai, Turkish, Turkmen, Ukrainian, Urdu, Uzbek, and Vietnamese.
16
- And also cover 16 programming languages: Java, JavaScript, Python, PHP, C, C++, C#, TypeScript, Go, SQL, Rust, Ruby, Scala, Lua, Assembly, and Visual Basic.
17
 
18
  FuxiTranyu-8B-DPO is trained using DPO with the UltraFeedback dataset, based on the [FuxiTranyu-8B](https://huggingface.co/TJUNLP/FuxiTranyu-8B) model.
19
 
20
- More details can be found at our technical report.
21
 
22
  We also provide the instruction fine-tuned version at [here](https://huggingface.co/TJUNLP/FuxiTranyu-8B-SFT).
23
  ## Usage
 
9
 
10
  ## Model Summary
11
 
12
+ FuxiTranyu-8B is an **open-source** **multilingual large language model** trained from scratch, with a specific focus on the multilinguality. It is trained on 600B tokens with a balanced data distribution across languages, exhibiting remarkable multilingual performance compared to previous multilingual LLMs like BLOOM-7B, PolyLM-13B.
 
13
 
14
+ FuxiTranyu supports 43 natural languages (Arabic, Bengali, Bulgarian, Burmese, Catalan, Chinese, Czech, Dutch, English, Filipino, Finnish, French, German, Greek, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Kazakh, Khmer, Korean, Kurdish, Kyrgyz, Lao, Malay, Persian, Polish, Portuguese, Romanian, Russian, Spanish, Swedish, Tamil, Tajik, Thai, Turkish, Turkmen, Ukrainian, Urdu, Uzbek, and Vietnamese) and cover 16 programming languages (Java, JavaScript, Python, PHP, C, C++, C#, TypeScript, Go, SQL, Rust, Ruby, Scala, Lua, Assembly, and Visual Basic).
 
15
 
16
  FuxiTranyu-8B-DPO is trained using DPO with the UltraFeedback dataset, based on the [FuxiTranyu-8B](https://huggingface.co/TJUNLP/FuxiTranyu-8B) model.
17
 
18
+ More details on the data collection & processing, pretraining and fine-tuning of FuxiTranyu can be found in the technical report.
19
 
20
  We also provide the instruction fine-tuned version at [here](https://huggingface.co/TJUNLP/FuxiTranyu-8B-SFT).
21
  ## Usage