Update README.md
Browse files
README.md
CHANGED
@@ -57,6 +57,6 @@ llama31.save_pretrained("./my-cool-llama3.2")
|
|
57 |
|
58 |
**Note:**
|
59 |
|
60 |
-
In the original tokenizer, there are date_string in tokenizer.chat_template (which append the current date when calling tokenizer.apply_chat_template()).
|
61 |
|
62 |
-
I removed this behavior in this repo. Please be aware when you use AutoTokenizer.from_pretrained(this_repo)
|
|
|
57 |
|
58 |
**Note:**
|
59 |
|
60 |
+
In the original tokenizer, there are `date_string` in `tokenizer.chat_template` (which append the current date when calling `tokenizer.apply_chat_template(messages)`).
|
61 |
|
62 |
+
I removed this behavior in this repo. Please be aware when you use `AutoTokenizer.from_pretrained(this_repo)`.
|