Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ base_model:
|
|
10 |
|
11 |

|
12 |
|
13 |
-
Welcome to Slim205/Barka-2b-it : The best 2B Arabic LLM
|
14 |
|
15 |
# Motivation :
|
16 |
|
@@ -21,6 +21,7 @@ Our final model was trained on a high-quality instruction fine-tuning (IFT) data
|
|
21 |
This model is the 2B version. It was trained for 2 days on 1 A100 GPU using LoRA with a rank of 128, a learning rate of 1e-4, and a cosine learning rate schedule.
|
22 |
|
23 |
# Evaluation :
|
|
|
24 |
|
25 |
| Metric | Slim205/Barka-2b-it |
|
26 |
|----------------------|---------------------|
|
@@ -40,4 +41,6 @@ This model is the 2B version. It was trained for 2 days on 1 A100 GPU using LoRA
|
|
40 |
| SCIQ | 55.78 |
|
41 |
| TOXIGEN | 78.29 |
|
42 |
|
43 |
-
Please refer to https://github.com/Slim205/Arabicllm/ for more details.
|
|
|
|
|
|
10 |
|
11 |

|
12 |
|
13 |
+
# Welcome to Slim205/Barka-2b-it : The best 2B Arabic LLM
|
14 |
|
15 |
# Motivation :
|
16 |
|
|
|
21 |
This model is the 2B version. It was trained for 2 days on 1 A100 GPU using LoRA with a rank of 128, a learning rate of 1e-4, and a cosine learning rate schedule.
|
22 |
|
23 |
# Evaluation :
|
24 |
+
My model is now on the Arabic leaderboard.
|
25 |
|
26 |
| Metric | Slim205/Barka-2b-it |
|
27 |
|----------------------|---------------------|
|
|
|
41 |
| SCIQ | 55.78 |
|
42 |
| TOXIGEN | 78.29 |
|
43 |
|
44 |
+
Please refer to https://github.com/Slim205/Arabicllm/ for more details.
|
45 |
+
|
46 |
+
# Feel free to use this model and send me your feedback. Together, we can advance Arabic LLM development!
|