etomoscow commited on
Commit
7a8fcfb
·
verified ·
1 Parent(s): d6738b1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -3,7 +3,7 @@ library_name: transformers
3
  tags:
4
  - detoxification
5
  - text_style_transfer
6
- license: mit
7
  datasets:
8
  - s-nlp/synthdetoxm
9
  language:
@@ -79,11 +79,11 @@ Specifically, we use the following metrics:
79
 
80
  - **Style Transfer Accuracy** (**STA**) is calculated with a [`textdetox/xlmr-large-toxicity-classifier`](https://huggingface.co/textdetox/xlmr-large-toxicity-classifier).
81
  - **Text Similarity** (**SIM**) is calculated as a similarity of text embeddings given by a [`sentence-transformers/LaBSE`](https://huggingface.co/sentence-transformers/LaBSE) encoder.
82
- - **Fluency** (**FL**) is calculated as a character n-gram F score - [$\text{ChrF}_1$](https://github.com/m-popovic/chrF).
83
 
84
  These metrics are aggregated in a final **Joint** metric (**J**):
85
 
86
- $$\textbf{J} = \frac{1}{n}\sum\limits_{i=1}^{n}\textbf{STA}(y_i) \cdot \textbf{SIM}(x_i,y_i) \cdot \textbf{FL}(x_i, y_i)$$,
87
 
88
  ### Evaluation Results
89
 
 
3
  tags:
4
  - detoxification
5
  - text_style_transfer
6
+ license: openrail++
7
  datasets:
8
  - s-nlp/synthdetoxm
9
  language:
 
79
 
80
  - **Style Transfer Accuracy** (**STA**) is calculated with a [`textdetox/xlmr-large-toxicity-classifier`](https://huggingface.co/textdetox/xlmr-large-toxicity-classifier).
81
  - **Text Similarity** (**SIM**) is calculated as a similarity of text embeddings given by a [`sentence-transformers/LaBSE`](https://huggingface.co/sentence-transformers/LaBSE) encoder.
82
+ - **Fluency** (**FL**) is calculated as a character n-gram F score - [ChrF1](https://github.com/m-popovic/chrF).
83
 
84
  These metrics are aggregated in a final **Joint** metric (**J**):
85
 
86
+ $$\textbf{J} = \frac{1}{n}\sum\limits_{i=1}^{n}\textbf{STA}(y_i) \cdot \textbf{SIM}(x_i,y_i) \cdot \textbf{FL}(x_i, y_i)$$
87
 
88
  ### Evaluation Results
89