bos_token_id == pad_token_id?

#1
by nlev - opened

Should bos_token_id be set to 151644 (<|im_start|>) instead of 151643 (<|endoftext|>) in config.json and generation_config.json?

Qwen org

Hi, please see our explaination at https://github.com/QwenLM/Qwen2/issues/486.

jklj077 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment