Hugging Face's logo

DISLab
/
SummLlama3-8B

Summarization
Safetensors
llama
Model card Files
Hwanjun commited on
Commit
57176cb
·
verified ·
1 Parent(s): 3074107

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -56,12 +56,18 @@ Here is the results:
56
 
57
  | **Config.** | **Faithfulness** | **Completeness** | **Conciseness** | **Average** |
58
  |--------------------|------------|-----------|-----------|----------|
59
- | Llama3-8b | 0.902 | 0.636 | 0.784 | 0.774 |
60
- | Llama3-70b | 0.953 | 0.659 | 0.792 | 0.801 |
61
  | **SummLlama3-8B** | **0.980** | **0.697** | **0.959** | **0.879** |
62
 
63
  ## Autoamted Evaluation using [FineSurE](link)
64
 
 
 
 
 
 
 
65
 
66
  See an example how the summary improved by SummLlama3-8B over Llama3-8/70B-Instruct on the document below:
67
 
 
56
 
57
  | **Config.** | **Faithfulness** | **Completeness** | **Conciseness** | **Average** |
58
  |--------------------|------------|-----------|-----------|----------|
59
+ | Llama3-8B-Instruct | 0.902 | 0.636 | 0.784 | 0.774 |
60
+ | Llama3-70B-Instruct | 0.953 | 0.659 | 0.792 | 0.801 |
61
  | **SummLlama3-8B** | **0.980** | **0.697** | **0.959** | **0.879** |
62
 
63
  ## Autoamted Evaluation using [FineSurE](link)
64
 
65
+ | **Config.** | **Faithfulness** | **Completeness** | **Conciseness** | **Average** |
66
+ |--------------------|------------|-----------|-----------|----------|
67
+ | Llama3-8B-Instruct | 0.864 | 0.583 | 0.450 | 0.632 |
68
+ | Llama3-70B-Instruct | 0.931 | 0.596 | 0.487 | 0.671 |
69
+ | **SummLlama3-8B** | **0.950** | **0.632** | **0.754** | **0.779** |
70
+
71
 
72
  See an example how the summary improved by SummLlama3-8B over Llama3-8/70B-Instruct on the document below:
73