How to get file tokenizer.json?

by AICoding91 - opened Oct 3, 2024

Oct 3, 2024

I see that there is not file tokenizer.json? I want to see the mapping between tokens and indices.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment