updating model card
Browse files
README.md
CHANGED
@@ -88,6 +88,18 @@ classification_pipeline("Given the comments above, this reviewer considers that
|
|
88 |
classification_pipeline("There are currently several activities on an international level that have identified the issue and activities are underway.")
|
89 |
```
|
90 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
91 |
## Citation
|
92 |
|
93 |
**BibTeX:**
|
|
|
88 |
classification_pipeline("There are currently several activities on an international level that have identified the issue and activities are underway.")
|
89 |
```
|
90 |
|
91 |
+
## Model Limitations
|
92 |
+
- *Human Assessment Required*: This model should not be used for automatic classification of grant peer review reports without human oversight.
|
93 |
+
- *Limited Training Data*: The model was fine-tuned on a limited sample of 2,500 annotated sentences. Therefore, its classification accuracy should be critically evaluated before deployment.
|
94 |
+
- *Specific Training Data*: The training data consists of a random sample of SNSF grant peer review reports. As such, the model's external validity to other datasets may be limited.
|
95 |
+
|
96 |
+
### Disclaimer
|
97 |
+
The classification accuracy of this model is notably low. Therefore, any deployment should be approached with caution and thorough consideration.
|
98 |
+
|
99 |
+
Since *Rationale* was only considered for *Positive* or *Negative* statements in the annotation, the predictions of the `snsf-data/specter2-review-rationale` model should be adapted in conjunction with the prediction of the models `snsf-data/specter2-review-positive` and `snsf-data/specter2-review-negative` as follows:
|
100 |
+
- if a sentence's prediction is either *Positive* or *Negative*, retain its *Rationale* prediction
|
101 |
+
- if a sentence's prediction is neither *Positive* nor *Negative*, disregard its *Rationale* prediction.
|
102 |
+
|
103 |
## Citation
|
104 |
|
105 |
**BibTeX:**
|