Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
MohamedRashad
/
arabic-tokenizers-leaderboard
like
28
Running
App
Files
Files
Community
2
Fetching metadata from the HF Docker repository...
a9aadc2
arabic-tokenizers-leaderboard
1 contributor
History:
6 commits
MohamedRashad
Refactor tokenize_text function to include better tokenization for Arabic Text
a9aadc2
9 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
Safe
269 Bytes
initial commit
10 months ago
app.py
Safe
8.04 kB
Refactor tokenize_text function to include better tokenization for Arabic Text
9 months ago
requirements.txt
Safe
54 Bytes
Add sentencepiece to requirements.txt
9 months ago
