Hugging Face's logo

Intel
/
opt-13b-int4-inc

English
Model card Files Community
yintongl commited on
Commit
e2dd961
·
verified ·
1 Parent(s): 59323cc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -48,7 +48,7 @@ Install [lm-eval-harness 0.4.2](https://github.com/EleutherAI/lm-evaluation-harn
48
  lm_eval --model hf --model_args pretrained="Intel/opt-13b-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu --batch_size 32
49
  ```
50
 
51
- | Metric | BF16 | INT4 |
52
  | -------------- | ------ | ------ |
53
  | Avg. | 0.4989 | 0.5021 |
54
  | mmlu | 0.2473 | 0.2456 |
 
48
  lm_eval --model hf --model_args pretrained="Intel/opt-13b-int4-inc",autogptq=True,gptq_use_triton=True --device cuda:0 --tasks lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu --batch_size 32
49
  ```
50
 
51
+ | Metric | FP16 | INT4 |
52
  | -------------- | ------ | ------ |
53
  | Avg. | 0.4989 | 0.5021 |
54
  | mmlu | 0.2473 | 0.2456 |