Commit
·
6b1add2
1
Parent(s):
e0dc07c
Update README.md
Browse files
README.md
CHANGED
|
@@ -43,3 +43,36 @@ We compare our solution with both open automatic spell checkers and the ChatGPT
|
|
| 43 |
| Yandex.Speller | 83.0 | 59.8 | 69.5 |
|
| 44 |
| JamSpell | 42.1 | 32.8 | 36.9 |
|
| 45 |
| HunSpell | 31.3 | 34.9 | 33.0 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
| Yandex.Speller | 83.0 | 59.8 | 69.5 |
|
| 44 |
| JamSpell | 42.1 | 32.8 | 36.9 |
|
| 45 |
| HunSpell | 31.3 | 34.9 | 33.0 |
|
| 46 |
+
|
| 47 |
+
**MultidomainGold**
|
| 48 |
+
| Model | Precision | Recall | F1 |
|
| 49 |
+
| --- | --- | --- | --- |
|
| 50 |
+
| M2M100-1.2B | 56.4 | 44.8 | 49.9 |
|
| 51 |
+
| ChatGPT gpt-3.5-turbo-0301 | 33.8 | 72.1 | 46.0 |
|
| 52 |
+
| ChatGPT gpt-4-0314 | 34.0 | 73.2 | 46.4 |
|
| 53 |
+
| ChatGPT text-davinci-003 | 33.6 | 72.0 | 45.8 |
|
| 54 |
+
| Yandex.Speller | 52.9 | 51.4 | 52.2 |
|
| 55 |
+
| JamSpell | 25.7 | 30.6 | 28.0 |
|
| 56 |
+
| HunSpell | 16.2 | 40.1 | 23.0 |
|
| 57 |
+
|
| 58 |
+
**MedSpellChecker**
|
| 59 |
+
| Модель | Precision | Recall | F1 |
|
| 60 |
+
| --- | --- | --- | --- |
|
| 61 |
+
| M2M100-1.2B | 63.7 | 57.8 | 60.6 |
|
| 62 |
+
| ChatGPT gpt-3.5-turbo-0301 | 53.2 | 67.6 | 59.6 |
|
| 63 |
+
| ChatGPT gpt-4-0314 | 54.2 | 69.4 | 60.9 |
|
| 64 |
+
| ChatGPT text-davinci-003 | 47.8 | 68.4 | 56.3 |
|
| 65 |
+
| Yandex.Speller | 80.6 | 47.8 | 60.0 |
|
| 66 |
+
| JamSpell | 24.6 | 29.7 | 26.9 |
|
| 67 |
+
| HunSpell | 10.3 | 40.2 | 16.4 |
|
| 68 |
+
|
| 69 |
+
**GitHubTypoCorpusRu**
|
| 70 |
+
| Модель | Precision | Recall | F1 |
|
| 71 |
+
| --- | --- | --- | --- |
|
| 72 |
+
| M2M100-1.2B | 45.7 | 41.4 | 43.5 |
|
| 73 |
+
| ChatGPT gpt-3.5-turbo-0301 | 43.8 | 57.0 | 49.6 |
|
| 74 |
+
| ChatGPT gpt-4-0314 | 45.2 | 58.2 | 51.0 |
|
| 75 |
+
| ChatGPT text-davinci-003 | 46.5 | 58.1 | 51.7 |
|
| 76 |
+
| Yandex.Speller | 67.7 | 37.5 | 48.3 |
|
| 77 |
+
| JamSpell | 49.5 | 29.9 | 37.3 |
|
| 78 |
+
| HunSpell | 28.5 | 30.7 | 29.6 |
|