EXL2 quants of Mistral 8x7B Instruct v0.1
Supported in ExLlamaV2 0.0.11 and up
2.40 bits per weight
2.50 bits per weight (still uploading)
2.70 bits per weight
3.00 bits per weight (still uploading)
3.50 bits per weight
4.00 bits per weight (still uploading)
5.00 bits per weight (still uploading)
6.00 bits per weight
8.00 bits per weight (still uploading)
