MASR / transformers /utils /test_module /custom_tokenization.py
Yuvarraj's picture
Initial commit
a0db2f9
raw
history blame contribute delete
88 Bytes
from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
pass