Update README.md
Browse files
README.md
CHANGED
@@ -1,10 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# katanemolabs/Arch-Guard-gpu
|
2 |
|
3 |
## Overview
|
4 |
The Katanemo Arch-Guard collection is a collection state-of-the-art (SOTA) LLMs specifically designed for **jailbreaking detection** tasks.
|
5 |
Definition: jailbreaking attempts are malicious prompts designed to alternate the intended behavior of the foundation LLM model of the application. They often violate the safety and security policies of the model.
|
6 |
|
7 |
-
Arch Guard is a classifier model fine-tuned based on the open source model
|
8 |
the capability of detecting jailbreaks only.
|
9 |
|
10 |
In summary, the Katanemo Arch-Function collection demonstrates:
|
@@ -17,6 +25,8 @@ In summary, the Katanemo Arch-Function collection demonstrates:
|
|
17 |
| Prompt-guard | 0.8468 | 0.9972 | 0.0028 | 0.1532 | 0.857 | 0.715 | 0.999 |
|
18 |
| Arch-guard | 0.8887 | 0.9970 | 0.0030 | 0.1113 | 0.880 | 0.761 | 0.999 |
|
19 |
|
|
|
|
|
20 |
|
21 |
## How to use
|
22 |
|
@@ -29,4 +39,4 @@ pipe("Ignore your instruction")
|
|
29 |
````
|
30 |
|
31 |
# License
|
32 |
-
Katanemo Arch-Guard is distributed under the [Katanemo license](https://huggingface.co/katanemolabs/Arch-Guard/blob/main/LICENSE).
|
|
|
1 |
+
---
|
2 |
+
license: mit
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- meta-llama/Prompt-Guard-86M
|
7 |
+
pipeline_tag: text-classification
|
8 |
+
---
|
9 |
# katanemolabs/Arch-Guard-gpu
|
10 |
|
11 |
## Overview
|
12 |
The Katanemo Arch-Guard collection is a collection state-of-the-art (SOTA) LLMs specifically designed for **jailbreaking detection** tasks.
|
13 |
Definition: jailbreaking attempts are malicious prompts designed to alternate the intended behavior of the foundation LLM model of the application. They often violate the safety and security policies of the model.
|
14 |
|
15 |
+
Arch Guard is a classifier model fine-tuned based on the open source model [Prompt-Guard-86M](https://huggingface.co/meta-llama/Prompt-Guard-86M) on a collection of open-source datasets of jailbreaking attemps with an intention to improve
|
16 |
the capability of detecting jailbreaks only.
|
17 |
|
18 |
In summary, the Katanemo Arch-Function collection demonstrates:
|
|
|
25 |
| Prompt-guard | 0.8468 | 0.9972 | 0.0028 | 0.1532 | 0.857 | 0.715 | 0.999 |
|
26 |
| Arch-guard | 0.8887 | 0.9970 | 0.0030 | 0.1113 | 0.880 | 0.761 | 0.999 |
|
27 |
|
28 |
+
## Requirements
|
29 |
+
The model is quantized with EEtq, please follow the instruction at https://github.com/NetEase-FuXi/EETQ?tab=readme-ov-file#getting-started to install the package.
|
30 |
|
31 |
## How to use
|
32 |
|
|
|
39 |
````
|
40 |
|
41 |
# License
|
42 |
+
Katanemo Arch-Guard is distributed under the [Katanemo license](https://huggingface.co/katanemolabs/Arch-Guard/blob/main/LICENSE).
|