Tuwhy commited on
Commit
c00c7cd
·
verified ·
1 Parent(s): dd75e20

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -10,4 +10,17 @@ tags:
10
  - Fine-Tuning
11
  - Multi-Image
12
  - MLLM
13
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  - Fine-Tuning
11
  - Multi-Image
12
  - MLLM
13
+ ---
14
+
15
+ # Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models
16
+ ![motivation](./assets/motivation.png)
17
+ Our paper, code, data, models can be found at [MIS](https://dripnowhy.github.io/MIS/).
18
+
19
+ ## Description
20
+ [InternVL2.5-8B](https://huggingface.co/OpenGVLab/InternVL2_5-8B) model fine-tuned on [MIS training set](https://huggingface.co/datasets/Tuwhy/MIS_Train).
21
+
22
+ ## MIRgae
23
+ ![mirage](./assets/model_fig.png)
24
+ Here is example pipeline of [MIS training set](https://huggingface.co/datasets/Tuwhy/MIS_Train) and MIRage safety CoT label construction.
25
+
26
+ You can fine-tune InternVL2.5 series using [their official doc](https://internvl.readthedocs.io/en/latest/internvl2.5/finetune.html).