Update README.md
Browse files
README.md
CHANGED
@@ -35,20 +35,8 @@ We use gates to fuse different LoRA modules. We employ few-shot training and hav
|
|
35 |
# Results
|
36 |
We have released the results for LoRAs and LoRA-Flow
|
37 |
|
38 |
-
| **Method** | | **MGSM (Math)** | | | | **HumanEval (Code)** | | | |
|
39 |
-
|-----------------------|-------|-------------------------------|---------|---------|---------|----------------------------------|---------|---------|---------|
|
40 |
-
| | | **Zh** | **Ru** | **Es** | **Avg.**| **Zh** | **Ru** | **Es** | **Avg.**|
|
41 |
-
| **Base Model** | | 4.4 | 3.2 | 2.4 | 3.3 | 0.0 | 0.0 | 2.4 | 0.8 |
|
42 |
-
| **Single LoRA** | Lang | 5.2 | 3.6 | 3.6 | 4.1 | 12.2 | 14.0 | 10.4 | 12.2 |
|
43 |
-
| | Task | 26.8 | 32.8 | 41.2 | 33.6 | 18.3 | 23.2 | 21.9 | 21.1 |
|
44 |
-
| **LoRA Fusion** | Avg | 12.8 | 10.4 | 18.4 | 13.9 | 17.1 | 17.7 | 18.3 | 17.7 |
|
45 |
-
| | LoRA-Hub | 20.8 | 28.4 | 36.8 | 28.7 | 19.5 | 21.3 | 20.1 | 20.3 |
|
46 |
-
| | LoRA-Flow | **33.2** | **37.6**| **42.0**| **37.6**| **20.7** | **23.8**| **23.2**| **22.6**|
|
47 |
|
48 |
<table border="1" cellspacing="0" cellpadding="10">
|
49 |
-
<caption>
|
50 |
-
Evaluation results on MGSM and HumanEval. ‘Lang’ denotes the chat LoRA in the target language and ‘Task’ represents the math or code LoRA trained in English. LoRA fusion methods combine the language LoRA and the task LoRA to accomplish the new task. The best score is highlighted in bold.
|
51 |
-
</caption>
|
52 |
<thead>
|
53 |
<tr>
|
54 |
<th rowspan="2">Method</th>
|
|
|
35 |
# Results
|
36 |
We have released the results for LoRAs and LoRA-Flow
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
|
39 |
<table border="1" cellspacing="0" cellpadding="10">
|
|
|
|
|
|
|
40 |
<thead>
|
41 |
<tr>
|
42 |
<th rowspan="2">Method</th>
|