Commit
·
9f6bb5d
1
Parent(s):
08aa6a0
Update README.md
Browse files
README.md
CHANGED
@@ -126,12 +126,17 @@ Benefits and Drawbacks:
|
|
126 |
- (**-**) Looses text-to-text ability
|
127 |
|
128 |
## Results
|
129 |
-
Results on the validation data of training tasks
|
130 |
| Dataset | Accuracy | F1 |
|
131 |
|:-------:|:--------:|:--:|
|
132 |
-
| MNLI (m)|
|
133 |
-
| MNLI (mm) | 0.
|
134 |
-
| SNLI | 0.
|
135 |
-
| SciTail | 0.
|
|
|
|
|
|
|
|
|
|
|
136 |
|
137 |
Special thanks to [philschmid](https://huggingface.co/philschmid) for making a Flan-T5-xxl [checkpoint](https://huggingface.co/philschmid/flan-t5-xxl-sharded-fp16) in fp16.
|
|
|
126 |
- (**-**) Looses text-to-text ability
|
127 |
|
128 |
## Results
|
129 |
+
Results on the validation data of **training tasks**:
|
130 |
| Dataset | Accuracy | F1 |
|
131 |
|:-------:|:--------:|:--:|
|
132 |
+
| MNLI (m)| 0.923 | 0.923 |
|
133 |
+
| MNLI (mm) | 0.922 | 0.922 |
|
134 |
+
| SNLI | 0.942 | 0.942 |
|
135 |
+
| SciTail | 0.966 | 0.647 |
|
136 |
+
|
137 |
+
Results on validation data of **unseen tasks** (zero-shot):
|
138 |
+
| Dataset | Accuracy | F1 |
|
139 |
+
|:-------:|:--------:|:--:|
|
140 |
+
| ?| ? | ? |
|
141 |
|
142 |
Special thanks to [philschmid](https://huggingface.co/philschmid) for making a Flan-T5-xxl [checkpoint](https://huggingface.co/philschmid/flan-t5-xxl-sharded-fp16) in fp16.
|