pycodegpt-CodeCLM-100m / added_tokens.json
fenchri's picture
Upload 8 files
3f027d0 verified
raw
history blame contribute delete
282 Bytes
{"<ruby>": 32008, "<javascript>": 32007, "<NEW_LINE>": 32012, "<java>": 32003, "<python>": 32004, "<eot>": 32001, "<DEDENT>": 32014, "<mask>": 32015, "<eod>": 32000, "<comments>": 32011, "<cn>": 32010, "<php>": 32006, "<go>": 32005, "<pad>": 32002, "<INDENT>": 32013, "<en>": 32009}