okasag commited on
Commit
2a90cd7
·
verified ·
1 Parent(s): 04e42b5

updating model card

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -88,6 +88,18 @@ classification_pipeline("Given the comments above, this reviewer considers that
88
  classification_pipeline("There are currently several activities on an international level that have identified the issue and activities are underway.")
89
  ```
90
 
 
 
 
 
 
 
 
 
 
 
 
 
91
  ## Citation
92
 
93
  **BibTeX:**
 
88
  classification_pipeline("There are currently several activities on an international level that have identified the issue and activities are underway.")
89
  ```
90
 
91
+ ## Model Limitations
92
+ - *Human Assessment Required*: This model should not be used for automatic classification of grant peer review reports without human oversight.
93
+ - *Limited Training Data*: The model was fine-tuned on a limited sample of 2,500 annotated sentences. Therefore, its classification accuracy should be critically evaluated before deployment.
94
+ - *Specific Training Data*: The training data consists of a random sample of SNSF grant peer review reports. As such, the model's external validity to other datasets may be limited.
95
+
96
+ ### Disclaimer
97
+ The classification accuracy of this model is notably low. Therefore, any deployment should be approached with caution and thorough consideration.
98
+
99
+ Since *Rationale* was only considered for *Positive* or *Negative* statements in the annotation, the predictions of the `snsf-data/specter2-review-rationale` model should be adapted in conjunction with the prediction of the models `snsf-data/specter2-review-positive` and `snsf-data/specter2-review-negative` as follows:
100
+ - if a sentence's prediction is either *Positive* or *Negative*, retain its *Rationale* prediction
101
+ - if a sentence's prediction is neither *Positive* nor *Negative*, disregard its *Rationale* prediction.
102
+
103
  ## Citation
104
 
105
  **BibTeX:**