AliShahroor
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -77,14 +77,14 @@ print(generated_text)
|
|
77 |
|
78 |
## Results
|
79 |
|
80 |
-
Below, we present the performance of **LlamaLens** compared to existing SOTA (if available) and the Llama-Instruct baseline, The
|
81 |
calculated as **(LLamalens β SOTA)**.
|
82 |
|
83 |
---
|
84 |
|
85 |
## Arabic
|
86 |
|
87 |
-
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** |
|
88 |
|------------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
89 |
| News Summarization | xlsum | R-2 | 0.137 | 0.034 | 0.075 | -0.062 |
|
90 |
| News Genre | ASND | Ma-F1 | 0.770 | 0.587 | 0.938 | 0.168 |
|
@@ -117,7 +117,7 @@ calculated as **(LLamalens β SOTA)**.
|
|
117 |
|
118 |
## English
|
119 |
|
120 |
-
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** |
|
121 |
|----------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
122 |
| News Summarization | xlsum | R-2 | 0.152 | 0.074 | 0.141 | -0.011 |
|
123 |
| News Genre | CNN_News_Articles | Acc | 0.940 | 0.644 | 0.915 | -0.025 |
|
@@ -141,7 +141,7 @@ calculated as **(LLamalens β SOTA)**.
|
|
141 |
|
142 |
## Hindi
|
143 |
|
144 |
-
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** |
|
145 |
|------------------------|------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
146 |
| NLI | NLI_dataset | W-F1 | 0.646 | 0.633 | 0.655 | 0.009 |
|
147 |
| News Summarization | xlsum | R-2 | 0.136 | 0.078 | 0.117 | -0.019 |
|
|
|
77 |
|
78 |
## Results
|
79 |
|
80 |
+
Below, we present the performance of **LlamaLens** compared to existing SOTA (if available) and the Llama-Instruct baseline, The βΞβ (Delta) column here is
|
81 |
calculated as **(LLamalens β SOTA)**.
|
82 |
|
83 |
---
|
84 |
|
85 |
## Arabic
|
86 |
|
87 |
+
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Ξ** (LLamalens - SOTA) |
|
88 |
|------------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
89 |
| News Summarization | xlsum | R-2 | 0.137 | 0.034 | 0.075 | -0.062 |
|
90 |
| News Genre | ASND | Ma-F1 | 0.770 | 0.587 | 0.938 | 0.168 |
|
|
|
117 |
|
118 |
## English
|
119 |
|
120 |
+
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Ξ** (LLamalens - SOTA) |
|
121 |
|----------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
122 |
| News Summarization | xlsum | R-2 | 0.152 | 0.074 | 0.141 | -0.011 |
|
123 |
| News Genre | CNN_News_Articles | Acc | 0.940 | 0.644 | 0.915 | -0.025 |
|
|
|
141 |
|
142 |
## Hindi
|
143 |
|
144 |
+
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Ξ** (LLamalens - SOTA) |
|
145 |
|------------------------|------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
146 |
| NLI | NLI_dataset | W-F1 | 0.646 | 0.633 | 0.655 | 0.009 |
|
147 |
| News Summarization | xlsum | R-2 | 0.136 | 0.078 | 0.117 | -0.019 |
|