Spaces:
Building
Building
Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
---
|
2 |
title: Hindi BPE Tokenizer
|
3 |
-
emoji:
|
4 |
colorFrom: blue
|
5 |
colorTo: green
|
6 |
sdk: docker
|
@@ -203,4 +203,4 @@ print(result['bpe_tokens'])
|
|
203 |
- it will show the original text, original tokens, bpe tokens, original encoded tokens, token numbers, stats, token details
|
204 |
|
205 |
UI Screenshot:
|
206 |
-

|
|
|
1 |
---
|
2 |
title: Hindi BPE Tokenizer
|
3 |
+
emoji: π
|
4 |
colorFrom: blue
|
5 |
colorTo: green
|
6 |
sdk: docker
|
|
|
203 |
- it will show the original text, original tokens, bpe tokens, original encoded tokens, token numbers, stats, token details
|
204 |
|
205 |
UI Screenshot:
|
206 |
+

|