TabShu commited on
Commit
5e86f34
·
1 Parent(s): 48d8b2e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +79 -0
README.md CHANGED
@@ -1,3 +1,82 @@
1
  ---
2
  license: openrail
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: openrail
3
+
4
+ datasets:
5
+ - LinkSoul/Chinese-LLaVA-Vision-Instructions
6
+ language:
7
+ - zh
8
+ - en
9
  ---
10
+
11
+
12
+ # Chinese LLaVA
13
+
14
+ 开源,可商用的**中英文双语视觉-语言助手 Chinese-LLaVA 以及中英文视觉 SFT 数据集 Chinese-LLaVA-Vision-Instructions**,支持中英文视觉-文本多模态对话的开源可商用对话模型。
15
+
16
+ <!--
17
+ <p align="center">
18
+ <img src="meta/preview.jpg" width="40%">
19
+ </p>
20
+ -->
21
+
22
+ ## 基础演示
23
+
24
+ ![Base Demo](meta/demo.gif)
25
+
26
+ ## 在线试玩
27
+
28
+ > Talk is cheap, Show you the Demo.
29
+ - [Demo 地址 / HuggingFace Spaces](https://huggingface.co/spaces/LinkSoul/Chinese-LLaVA)
30
+
31
+ ## 资源下载
32
+
33
+ - 模型:
34
+ - [Chinese-LLaVA-Chinese-Llama-2-7B](https://huggingface.co/LinkSoul/Chinese-LLaVA-Cllama2)
35
+ - [Chinese-LLaVA-Baichuan-7B](https://huggingface.co/LinkSoul/Chinese-LLaVA-Baichuan)
36
+
37
+ - 数据集:[Chinese-LLaVA-Vision-Instructions](https://huggingface.co/datasets/LinkSoul/Chinese-LLaVA-Vision-Instructions)
38
+
39
+ ## 环境安装
40
+ ```shell
41
+ # clone the repository
42
+ git clone https://github.com/LinkSoul-AI/Chinese-LLaVA
43
+ cd Chinese-LLaVA
44
+
45
+ # install package
46
+ conda create -n Cllava python=3.10 -y
47
+ conda activate Cllava
48
+ pip install --upgrade pip
49
+ pip install -e .
50
+ ```
51
+
52
+ ## 快速测试
53
+
54
+ ```shell
55
+ python infer.py \
56
+ --model-name PATH/TO/THE/CHINESE_LLAVA_MODEL \
57
+ --llm-type "Chinese_llama2" or "baichuan" \
58
+ --image-file PATH/TO/THE/INPUT/IMAGE \
59
+ --query QUERY/PROMPT
60
+ ```
61
+
62
+ ## TODO
63
+ - 如何训练
64
+ - int4 量化
65
+ - docker 部署
66
+
67
+ ## 相关项目
68
+
69
+ - [LLaVA](https://llava-vl.github.io/)
70
+ - [Chinese-Llama-2-7B](https://huggingface.co/LinkSoul/Chinese-Llama-2-7b)
71
+ - [baichuan-inc/Baichuan-7B](https://huggingface.co/baichuan-inc/Baichuan-7B)
72
+
73
+
74
+ ## 项目协议
75
+
76
+ [Apache-2.0 license](https://github.com/LinkSoul-AI/Chinese-LLaVA/blob/main/LICENSE)
77
+
78
+ ## 微信交流群
79
+ <!--
80
+ <img src=".github/QRcode.jpg" alt="微信交流群" width="300"/>
81
+ -->
82
+ 欢迎加入[微信群](meta/QRcode.jpg)