dardem commited on
Commit
6753c65
·
1 Parent(s): 6d26035

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - fr
5
+ - it
6
+ - pt
7
+ tags:
8
+ - formality
9
+ licenses:
10
+ - cc-by-nc-sa
11
+ ---
12
+
13
+
14
+ **Model Overview**
15
+
16
+ This is the model presented in the paper "Detecting Text Formality: A Study of Text Classification Approaches".
17
+
18
+ The original model is [mDeBERTa (base)](https://huggingface.co/microsoft/mdeberta-v3-base). Then, it was fine-tuned on the multilingual corpus for fomality classiication [X-FORMAL](https://arxiv.org/abs/2104.04108) that consists of 4 languages -- English (from [GYAFC](https://arxiv.org/abs/1803.06535)), French, Italian, and Brazilian Portuguese.
19
+ In our experiments, the model showed the best results within Transformer-based models for the multilingual formality classification task. More details, code and data can be found [here](https://github.com/s-nlp/formality).
20
+
21
+ **Evaluation Results**
22
+
23
+ Here, we provide several metrics of the best models from each category participated in the comparison to understand the ranks of values. We report accuracy score for two setups -- multilingual model fine-tuned for each language separately and then fine-tuned on all languages.
24
+
25
+ | | En | It | Po | Fr | All |
26
+ |------------------|------|------|------|------|-------|
27
+ | bag-of-words | 79.1 | 71.3 | 70.6 | 72.5 | --- |
28
+ | CharBiLSTM | 87.0 | 79.1 | 75.9 | 81.3 | 82.7 |
29
+ | mDistilBERT-cased| 86.6 | 76.8 | 75.9 | 79.1 | 79.4 |
30
+ | mDeBERTa-base | 87.3 | 76.6 | 75.8 | 78.9 | 79.9 |
31
+
32
+ **How to use**
33
+ ```python
34
+ from transformers import AutoModelForSequenceClassification, AutoTokenizer
35
+ model_name = 'mdeberta-base-formality-ranker'
36
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
37
+ model = AutoModelForSequenceClassification.from_pretrained(model_name)
38
+ ```
39
+
40
+ **Citation**
41
+ ```
42
+ TBD
43
+ ```
44
+
45
+ ## Licensing Information
46
+
47
+ [Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License][cc-by-nc-sa].
48
+
49
+ [![CC BY-NC-SA 4.0][cc-by-nc-sa-image]][cc-by-nc-sa]
50
+
51
+ [cc-by-nc-sa]: http://creativecommons.org/licenses/by-nc-sa/4.0/
52
+ [cc-by-nc-sa-image]: https://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png