Hugging Face's logo

studio-ousia
/
luke-japanese-base-lite

Fill-Mask
Transformers
PyTorch
Japanese
luke
named entity recognition
entity typing
relation classification
question answering
Inference Endpoints
Model card Files Community
1
ikuyamada commited on
Commit
0a1f489
·
1 Parent(s): 31f9088

add the results on JSTS v1.1

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -37,15 +37,15 @@ The experimental results evaluated on the dev set of
37
  | Model | MARC-ja | JSTS | JNLI | JCommonsenseQA |
38
  | ---------------------- | --------- | ------------------- | --------- | -------------- |
39
  | | acc | Pearson/Spearman | acc | acc |
40
- | **LUKE Japanese base** | **0.965** | **0.912**/**0.875** | **0.912** | **0.842** |
41
  | _Baselines:_ | |
42
- | Tohoku BERT base | 0.958 | 0.899/0.859 | 0.899 | 0.808 |
43
- | NICT BERT base | 0.958 | 0.903/0.867 | 0.902 | 0.823 |
44
- | Waseda RoBERTa base | 0.962 | 0.901/0.865 | 0.895 | 0.840 |
45
- | XLM RoBERTa base | 0.961 | 0.870/0.825 | 0.893 | 0.687 |
46
 
47
  The baseline scores are obtained from
48
- [here](https://github.com/yahoojapan/JGLUE/tree/9f650417195ec54a080411f44e2395012979d42e#baseline-scores).
49
 
50
  ### Citation
51
 
 
37
  | Model | MARC-ja | JSTS | JNLI | JCommonsenseQA |
38
  | ---------------------- | --------- | ------------------- | --------- | -------------- |
39
  | | acc | Pearson/Spearman | acc | acc |
40
+ | **LUKE Japanese base** | **0.965** | **0.916**/**0.877** | **0.912** | **0.842** |
41
  | _Baselines:_ | |
42
+ | Tohoku BERT base | 0.958 | 0.909/0.868 | 0.899 | 0.808 |
43
+ | NICT BERT base | 0.958 | 0.910/0.871 | 0.902 | 0.823 |
44
+ | Waseda RoBERTa base | 0.962 | 0.913/0.873 | 0.895 | 0.840 |
45
+ | XLM RoBERTa base | 0.961 | 0.877/0.831 | 0.893 | 0.687 |
46
 
47
  The baseline scores are obtained from
48
+ [here](https://github.com/yahoojapan/JGLUE/blob/a6832af23895d6faec8ecf39ec925f1a91601d62/README.md).
49
 
50
  ### Citation
51