bongsoo commited on
Commit
9f6a76a
ยท
1 Parent(s): 34a9ce1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -13,6 +13,24 @@ This is a [sentence-transformers](https://www.SBERT.net) model: It maps sentence
13
 
14
  klue/bert-base ๋ชจ๋ธ์„ sentencebert๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ ๋ชจ๋ธ
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  ## Citing & Authors
18
 
 
13
 
14
  klue/bert-base ๋ชจ๋ธ์„ sentencebert๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ ๋ชจ๋ธ
15
 
16
+ ## Evaluation Results
17
+
18
+ - ์„ฑ๋Šฅ ์ธก์ •์„ ์œ„ํ•œ ๋ง๋ญ‰์น˜๋Š”, ์•„๋ž˜ ํ•œ๊ตญ์–ด (kor), ์˜์–ด(en) ํ‰๊ฐ€ ๋ง๋ญ‰์น˜๋ฅผ ์ด์šฉํ•จ
19
+ <br> ํ•œ๊ตญ์–ด : **korsts(1,379์Œ๋ฌธ์žฅ)** ์™€ **klue-sts(519์Œ๋ฌธ์žฅ)**
20
+ <br> ์˜์–ด : [stsb_multi_mt](https://huggingface.co/datasets/stsb_multi_mt)(1,376์Œ๋ฌธ์žฅ) ์™€ [glue:stsb](https://huggingface.co/datasets/glue/viewer/stsb/validation) (1,500์Œ๋ฌธ์žฅ)
21
+ - ์„ฑ๋Šฅ ์ง€ํ‘œ๋Š” **cosin.spearman**
22
+ - ํ‰๊ฐ€ ์ธก์ • ์ฝ”๋“œ๋Š” [์—ฌ๊ธฐ](https://github.com/kobongsoo/BERT/blob/master/sbert/sbert-test3.ipynb) ์ฐธ์กฐ
23
+ -
24
+ |๋ชจ๋ธ |korsts|klue-sts|glue(stsb)|stsb_multi_mt(en)|
25
+ |:--------|------:|--------:|--------------:|------------:|
26
+ |distiluse-base-multilingual-cased-v2 |0.7475 |0.7855 |0.8193 |0.8075|
27
+ |paraphrase-multilingual-mpnet-base-v2 |0.8201 |0.7993 |0.8907 |0.8682|
28
+ |bongsoo/albert-small-kor-sbert-v1 |0.8305 |0.8588 |0.8419 |0.7965|
29
+ |bongsoo/kpf-sbert-v1.0 |0.8590 |0.8924 |0.8840 |0.8531|
30
+ |**bongsoo/klue-sbert-v1.0** |0.8529 |0.8952 |0.8813 |0.8469|
31
+
32
+ For an automated evaluation of this model, see the *Sentence Embeddings Benchmark*: [https://seb.sbert.net](https://seb.sbert.net?model_name={MODEL_NAME})
33
+
34
 
35
  ## Citing & Authors
36