Francesco-A
/

code-search-net-tokenizer

python tokenizer

Model card Files Files and versions Community

Francesco-A commited on Aug 9, 2023

Commit

66e548a

·

1 Parent(s): e50dc1c

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -5,6 +5,8 @@ datasets:
 language:
 - code
 tags:
 - code tokenizer
 - python tokenizer
 - GPT-2

 language:
 - code
 tags:
+- PyTorch
+- Transformers
 - code tokenizer
 - python tokenizer
 - GPT-2