Got garbled Chinese characters
#1
by
conun
- opened
- Example:
e.g. payload = {
"messages": [
{"role": "user", "content": "青椒肉丝的做法"},
],
}
garbled result snippets:
- �粉：适量（用于腌肉）
- �：少许（增加鲜味）
- �精或鸡粉（可选）：适量
- also got garbled Chinese characters when using q0f16
- It's ok when do inference with vllm + origin Qwen2-7B-Instruct