ArthurConmy
/

redwood_tokenizer

Model card Files Files and versions Community

redwood_tokenizer

Commit History

add readme and correct pad token

fc42dc0

ArthurConmy commited on Mar 19, 2023

From slow

35a30a4

ArthurConmy commited on Mar 19, 2023

New config

49348b6

ArthurConmy commited on Mar 19, 2023

Comma

8b5aa0a

ArthurConmy commited on Mar 19, 2023

mess withy config

7e5a865

ArthurConmy commited on Mar 19, 2023

Not fast?

fde94cf

ArthurConmy commited on Mar 19, 2023

Add2

1b9a6ed

ArthurConmy commited on Mar 19, 2023

Add

046d34d

ArthurConmy commited on Mar 19, 2023

Fix spec toks?

6dcde67

ArthurConmy commited on Mar 19, 2023

Change config

ef534a8

ArthurConmy commited on Mar 19, 2023

gitignore

645be37

ArthurConmy commited on Mar 19, 2023

Initial commit

5824687

ArthurConmy commited on Mar 19, 2023

initial commit

30b275f

ArthurConmy commited on Mar 19, 2023