Update README.md
Browse files
README.md
CHANGED
@@ -3,7 +3,7 @@ library_name: transformers
|
|
3 |
tags:
|
4 |
- detoxification
|
5 |
- text_style_transfer
|
6 |
-
license:
|
7 |
datasets:
|
8 |
- s-nlp/synthdetoxm
|
9 |
language:
|
@@ -79,11 +79,11 @@ Specifically, we use the following metrics:
|
|
79 |
|
80 |
- **Style Transfer Accuracy** (**STA**) is calculated with a [`textdetox/xlmr-large-toxicity-classifier`](https://huggingface.co/textdetox/xlmr-large-toxicity-classifier).
|
81 |
- **Text Similarity** (**SIM**) is calculated as a similarity of text embeddings given by a [`sentence-transformers/LaBSE`](https://huggingface.co/sentence-transformers/LaBSE) encoder.
|
82 |
-
- **Fluency** (**FL**) is calculated as a character n-gram F score - [
|
83 |
|
84 |
These metrics are aggregated in a final **Joint** metric (**J**):
|
85 |
|
86 |
-
$$\textbf{J} = \frac{1}{n}\sum\limits_{i=1}^{n}\textbf{STA}(y_i) \cdot \textbf{SIM}(x_i,y_i) \cdot \textbf{FL}(x_i, y_i)
|
87 |
|
88 |
### Evaluation Results
|
89 |
|
|
|
3 |
tags:
|
4 |
- detoxification
|
5 |
- text_style_transfer
|
6 |
+
license: openrail++
|
7 |
datasets:
|
8 |
- s-nlp/synthdetoxm
|
9 |
language:
|
|
|
79 |
|
80 |
- **Style Transfer Accuracy** (**STA**) is calculated with a [`textdetox/xlmr-large-toxicity-classifier`](https://huggingface.co/textdetox/xlmr-large-toxicity-classifier).
|
81 |
- **Text Similarity** (**SIM**) is calculated as a similarity of text embeddings given by a [`sentence-transformers/LaBSE`](https://huggingface.co/sentence-transformers/LaBSE) encoder.
|
82 |
+
- **Fluency** (**FL**) is calculated as a character n-gram F score - [ChrF1](https://github.com/m-popovic/chrF).
|
83 |
|
84 |
These metrics are aggregated in a final **Joint** metric (**J**):
|
85 |
|
86 |
+
$$\textbf{J} = \frac{1}{n}\sum\limits_{i=1}^{n}\textbf{STA}(y_i) \cdot \textbf{SIM}(x_i,y_i) \cdot \textbf{FL}(x_i, y_i)$$
|
87 |
|
88 |
### Evaluation Results
|
89 |
|