Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json 9a72bb7 verified Niansuh commited on Aug 4, 2024
Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json 14c8e9c verified Niansuh commited on Aug 4, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 21b92d4 verified Niansuh commited on Aug 4, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt b62a914 verified Niansuh commited on Aug 4, 2024