Updated model with better training and evaluation. Test and val data included as pickle files. Older Legacy files were removed to avoid confusion.
034082e
| model.safetensors filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/a8/f7/a8f7cb65577aa50b1c49fd5e0cb7beef2d858cdd37baa16adc932ac5370c60b0 filter=lfs diff=lfs merge=lfs -text | |
| .git/lfs/objects/1c/44/1c44e50620136eaacd05a96a354f8255cf1be856117f155c8786525b6b9f11a1 filter=lfs diff=lfs merge=lfs -text | |
| test_data.pickle filter=lfs diff=lfs merge=lfs -text | |
| val_data.pickle filter=lfs diff=lfs merge=lfs -text | |
| sentencepiece.bpe.model filter=lfs diff=lfs merge=lfs -text | |