Update README.md
Browse files
README.md
CHANGED
|
@@ -46,6 +46,8 @@ Suitable `json` files have been provided to easily apply the prompting format in
|
|
| 46 |
|
| 47 |
Note: the prompting format is **intentionally different** from that of the Mistral-Instruct base model.
|
| 48 |
|
|
|
|
|
|
|
| 49 |
## Block characters
|
| 50 |
The model uses a _ChatML-like_ prompting format with a few changes from the usual roles typically used for ChatGPT-like assistant chatbots. The first is that to avoid complications with tokenization and special tokens, `<|im_start|>` has been replaced with `▀` (upper half block character) and `<|im_end|>` has been replaced with `▄` (lower half block character).
|
| 51 |
|
|
|
|
| 46 |
|
| 47 |
Note: the prompting format is **intentionally different** from that of the Mistral-Instruct base model.
|
| 48 |
|
| 49 |
+
It is advised to use `▀` as a stop token.
|
| 50 |
+
|
| 51 |
## Block characters
|
| 52 |
The model uses a _ChatML-like_ prompting format with a few changes from the usual roles typically used for ChatGPT-like assistant chatbots. The first is that to avoid complications with tokenization and special tokens, `<|im_start|>` has been replaced with `▀` (upper half block character) and `<|im_end|>` has been replaced with `▄` (lower half block character).
|
| 53 |
|