cwang621 commited on
Commit
c6340a4
·
verified ·
1 Parent(s): 6df8fc2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -3
README.md CHANGED
@@ -1,3 +1,49 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+ # BLSP-Emo: Towards Empathetic Large Language-Speech Models via Self-Alignment
5
+
6
+ Chen Wang, Minpeng Liao, Zhongqiang Huang,Junhong Wu, Chenqing Zong, Jiajun Zhang
7
+
8
+ **Institute of Automation, Chinese Academy of Sciences**
9
+
10
+ **Alibaba Group**
11
+
12
+ <a href='https://www.modelscope.cn/studios/Decaderan/Blsp-Qwen-7B-Demo/summary'><img src='https://img.shields.io/badge/ModelScope-Demo-blueviolet'></a>
13
+ <a href=''><img src='https://img.shields.io/badge/ModelScope-Checkpoint-blueviolet'></a>
14
+ <a href=''><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Checkpoint-blue'></a> <a href='https://cwang621.github.io/blsp-emo.github.io'><img src='https://img.shields.io/badge/Project-Page-Green'></a> <a href='https://arxiv.org/abs/2406.03872'><img src='https://img.shields.io/badge/Paper-Arxiv-red'> </a>
15
+
16
+
17
+ ## Introduction
18
+
19
+ * BLSP-Emo is designed to enable an end-to-end speech-language model to understand emotions in speech and generate empathetic responses, using only existing ASR and SER data.
20
+ * BLSP-Emo is built based on Whisper-large-v2 and Qwen-7B-Chat.
21
+
22
+ ![architecture](figures/emotion_blsp.png)
23
+
24
+ ## Example
25
+
26
+ ![Demo](figures/emo-motivation.png)
27
+
28
+
29
+
30
+ More examples can be found in the [project page](https://cwang621.github.io/blsp-emo.github.io). You can also try our model online at [modelscope](https://www.modelscope.cn/studios/Decaderan/Blsp-Qwen-7B-Demo/summary).
31
+
32
+
33
+
34
+ ## License
35
+ * The license of our project is [Apache License 2.0]()
36
+ * Our models are based on Qwen and Whisper. If you want to use our models, please do not violate the [MIT License](https://github.com/openai/whisper/blob/main/LICENSE) of whisper and the [License](https://github.com/QwenLM/Qwen/blob/main/LICENSE) of Qwen
37
+
38
+ ## Citation
39
+ If you find our project useful, hope you can star our repo and cite our paper as follows:
40
+ ```
41
+ @misc{wang2024blspemo,
42
+ title={BLSP-Emo: Towards Empathetic Large Speech-Language Models},
43
+ author={Chen Wang and Minpeng Liao and Zhongqiang Huang and Junhong Wu and Chengqing Zong and Jiajun Zhang},
44
+ year={2024},
45
+ eprint={2406.03872},
46
+ archivePrefix={arXiv},
47
+ primaryClass={cs.CL}
48
+ }
49
+ ```