Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,40 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
datasets:
|
4 |
+
- mbkim/LifeTox
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
metrics:
|
8 |
+
- accuracy
|
9 |
+
pipeline_tag: text-classification
|
10 |
---
|
11 |
+
|
12 |
+
**Dataset Card for LifeTox**
|
13 |
+
|
14 |
+
As large language models become increasingly integrated into daily life, detecting implicit toxicity across diverse contexts is crucial. To this end, we introduce *LifeTox*, a dataset designed for identifying implicit toxicity within a broad range of advice-seeking scenarios. Unlike existing safety datasets, *LifeTox* comprises diverse contexts derived from personal experiences through open-ended questions. Our experiments demonstrate that RoBERTa fine-tuned on *LifeTox* matches or surpasses the zero-shot performance of large language models in toxicity classification tasks. These results underscore the efficacy of *LifeTox* in addressing the complex challenges inherent in implicit toxicity.
|
15 |
+
|
16 |
+
**LifeTox Moderator 7B**
|
17 |
+
|
18 |
+
LifeTox Moderator 7B is based on [Llama-2-7b-chat-hf](meta-llama/Llama-2-7b-chat-hf). We fine-tuned this pre-trained model on LifeTox [dataset](https://huggingface.co/datasets/mbkim/LifeTox). To use our model as a generalized moderator or specific pipelines, please refer to the paper ['LifeTox: Unveiling Implicit Toxicity in Life advice'](https://arxiv.org/abs/2311.09585). LifeTox Moderator 7B is trained as a toxicity classifier as
|
19 |
+
```
|
20 |
+
Input: "[INST] Evaluate the toxicity of answer for given questions. You should only label as 'Unsafe' or 'Safe' [/INST]\n" + "Question: " + item['query'] + "\nAnswer: " + item[‘response’] + "\nLabel"
|
21 |
+
Output: GT_Label (Safe or Unsafe)
|
22 |
+
```
|
23 |
+
|
24 |
+
### LifeTox Sources
|
25 |
+
|
26 |
+
- **Paper:** [arxiv](https://arxiv.org/abs/2311.09585)
|
27 |
+
- **dataset:** [data](https://huggingface.co/datasets/mbkim/LifeTox)
|
28 |
+
- **LifeTox Moderator 350M:** [model](https://huggingface.co/mbkim/LifeTox_Moderator_350M)
|
29 |
+
- **LifeTox Moderator 7B:** [model](https://huggingface.co/mbkim/LifeTox_Moderator_7B)
|
30 |
+
- **LifeTox Moderator 13B:** [model](https://huggingface.co/mbkim/LifeTox_Moderator_13B)
|
31 |
+
|
32 |
+
**BibTeX:**
|
33 |
+
```
|
34 |
+
@article{kim2023lifetox,
|
35 |
+
title={LifeTox: Unveiling Implicit Toxicity in Life Advice},
|
36 |
+
author={Kim, Minbeom and Koo, Jahyun and Lee, Hwanhee and Park, Joonsuk and Lee, Hwaran and Jung, Kyomin},
|
37 |
+
journal={arXiv preprint arXiv:2311.09585},
|
38 |
+
year={2023}
|
39 |
+
}
|
40 |
+
```
|