Intel
/

Baichuan2-7B-Chat-int4-inc

Model card Files Files and versions Community

yintongl commited on May 21, 2024

Commit

8ef4607

·

verified ·

1 Parent(s): 562525a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -50,7 +50,7 @@ lm_eval --model hf --model_args pretrained="Intel/Baichuan2-7B-Chat-int4-inc",au
-| Metric         | BF16   | INT4   |
 | -------------- | ------ | ------ |
 | Avg.           | 0.5711 | 0.5674 |
 | mmlu           | 0.5082 | 0.5062 |

+| Metric         | FP16   | INT4   |
 | -------------- | ------ | ------ |
 | Avg.           | 0.5711 | 0.5674 |
 | mmlu           | 0.5082 | 0.5062 |