Fix required for config.json >> BOS Token ID - Incoherent outputs
#8
by
mindkrypted
- opened
It appears that the variable "bos_token_id": 151643 has the wrong value in config.json.
When using the model with the defaults makes it highly incoherent and most of the time it won't stop / stuck in a loop.
Setting "bos_token_id" to 151646 makes the model "usable".generation_config.json exposed that value.
Isn't 151646 'eos_token_id'? how can they be the same?