QCRI
/

AliShahroor commited on
Commit
d9ff944
Β·
verified Β·
1 Parent(s): 67a2b6c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -77,14 +77,14 @@ print(generated_text)
77
 
78
  ## Results
79
 
80
- Below, we present the performance of **LlamaLens** compared to existing SOTA (if available) and the Llama-Instruct baseline, The β€œDelta” column here is
81
  calculated as **(LLamalens – SOTA)**.
82
 
83
  ---
84
 
85
  ## Arabic
86
 
87
- | **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Delta** (LLamalens - SOTA) |
88
  |------------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
89
  | News Summarization | xlsum | R-2 | 0.137 | 0.034 | 0.075 | -0.062 |
90
  | News Genre | ASND | Ma-F1 | 0.770 | 0.587 | 0.938 | 0.168 |
@@ -117,7 +117,7 @@ calculated as **(LLamalens – SOTA)**.
117
 
118
  ## English
119
 
120
- | **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Delta** (LLamalens - SOTA) |
121
  |----------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
122
  | News Summarization | xlsum | R-2 | 0.152 | 0.074 | 0.141 | -0.011 |
123
  | News Genre | CNN_News_Articles | Acc | 0.940 | 0.644 | 0.915 | -0.025 |
@@ -141,7 +141,7 @@ calculated as **(LLamalens – SOTA)**.
141
 
142
  ## Hindi
143
 
144
- | **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Delta** (LLamalens - SOTA) |
145
  |------------------------|------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
146
  | NLI | NLI_dataset | W-F1 | 0.646 | 0.633 | 0.655 | 0.009 |
147
  | News Summarization | xlsum | R-2 | 0.136 | 0.078 | 0.117 | -0.019 |
 
77
 
78
  ## Results
79
 
80
+ Below, we present the performance of **LlamaLens** compared to existing SOTA (if available) and the Llama-Instruct baseline, The β€œΞ”β€ (Delta) column here is
81
  calculated as **(LLamalens – SOTA)**.
82
 
83
  ---
84
 
85
  ## Arabic
86
 
87
+ | **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Ξ”** (LLamalens - SOTA) |
88
  |------------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
89
  | News Summarization | xlsum | R-2 | 0.137 | 0.034 | 0.075 | -0.062 |
90
  | News Genre | ASND | Ma-F1 | 0.770 | 0.587 | 0.938 | 0.168 |
 
117
 
118
  ## English
119
 
120
+ | **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Ξ”** (LLamalens - SOTA) |
121
  |----------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
122
  | News Summarization | xlsum | R-2 | 0.152 | 0.074 | 0.141 | -0.011 |
123
  | News Genre | CNN_News_Articles | Acc | 0.940 | 0.644 | 0.915 | -0.025 |
 
141
 
142
  ## Hindi
143
 
144
+ | **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Ξ”** (LLamalens - SOTA) |
145
  |------------------------|------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
146
  | NLI | NLI_dataset | W-F1 | 0.646 | 0.633 | 0.655 | 0.009 |
147
  | News Summarization | xlsum | R-2 | 0.136 | 0.078 | 0.117 | -0.019 |