mbkim commited on
Commit
027a31b
·
verified ·
1 Parent(s): 71a7dad

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md CHANGED
@@ -1,3 +1,40 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - mbkim/LifeTox
5
+ language:
6
+ - en
7
+ metrics:
8
+ - accuracy
9
+ pipeline_tag: text-classification
10
  ---
11
+
12
+ **Dataset Card for LifeTox**
13
+
14
+ As large language models become increasingly integrated into daily life, detecting implicit toxicity across diverse contexts is crucial. To this end, we introduce *LifeTox*, a dataset designed for identifying implicit toxicity within a broad range of advice-seeking scenarios. Unlike existing safety datasets, *LifeTox* comprises diverse contexts derived from personal experiences through open-ended questions. Our experiments demonstrate that RoBERTa fine-tuned on *LifeTox* matches or surpasses the zero-shot performance of large language models in toxicity classification tasks. These results underscore the efficacy of *LifeTox* in addressing the complex challenges inherent in implicit toxicity.
15
+
16
+ **LifeTox Moderator 7B**
17
+
18
+ LifeTox Moderator 7B is based on [Llama-2-7b-chat-hf](meta-llama/Llama-2-7b-chat-hf). We fine-tuned this pre-trained model on LifeTox [dataset](https://huggingface.co/datasets/mbkim/LifeTox). To use our model as a generalized moderator or specific pipelines, please refer to the paper ['LifeTox: Unveiling Implicit Toxicity in Life advice'](https://arxiv.org/abs/2311.09585). LifeTox Moderator 7B is trained as a toxicity classifier as
19
+ ```
20
+ Input: "[INST] Evaluate the toxicity of answer for given questions. You should only label as 'Unsafe' or 'Safe' [/INST]\n" + "Question: " + item['query'] + "\nAnswer: " + item[‘response’] + "\nLabel"
21
+ Output: GT_Label (Safe or Unsafe)
22
+ ```
23
+
24
+ ### LifeTox Sources
25
+
26
+ - **Paper:** [arxiv](https://arxiv.org/abs/2311.09585)
27
+ - **dataset:** [data](https://huggingface.co/datasets/mbkim/LifeTox)
28
+ - **LifeTox Moderator 350M:** [model](https://huggingface.co/mbkim/LifeTox_Moderator_350M)
29
+ - **LifeTox Moderator 7B:** [model](https://huggingface.co/mbkim/LifeTox_Moderator_7B)
30
+ - **LifeTox Moderator 13B:** [model](https://huggingface.co/mbkim/LifeTox_Moderator_13B)
31
+
32
+ **BibTeX:**
33
+ ```
34
+ @article{kim2023lifetox,
35
+ title={LifeTox: Unveiling Implicit Toxicity in Life Advice},
36
+ author={Kim, Minbeom and Koo, Jahyun and Lee, Hwanhee and Park, Joonsuk and Lee, Hwaran and Jung, Kyomin},
37
+ journal={arXiv preprint arXiv:2311.09585},
38
+ year={2023}
39
+ }
40
+ ```