imatrix test data?
#4
by
eramax
- opened
To generate the imatrix should you use wiki_test_data or any dataset, I don't see in your code you have used any dataset.
Your
imatrix.txtis expected to be located inside theimatrixfolder. I have already included a file that is considered a good starting option, this discussion is where it came from. (...)
The included data is Kalomaze's groups_merged.txt (30k).
Using wiki.train with 200*512 or 100*512 tokens seems also popular, although the quality compared to the "diverse data" example might not be substantially different/or could be worse. It's uncertain, you might need to test and do benchmarks in your use case.
FantasiaFoundry
changed discussion status to
closed