macadeliccc commited on
Commit
6b580ed
·
verified ·
1 Parent(s): de08859

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -22
README.md CHANGED
@@ -4,8 +4,6 @@ library_name: transformers
4
  ---
5
  # Laser-Dolphin-Mixtral-4x7b-dpo
6
 
7
- *New version is coming because of chat template issues. The other MoE models in my collection do not have this issue and have been tested more*
8
-
9
  ![laser_dolphin_image](./dolphin_moe.png)
10
 
11
  Credit to Fernando Fernandes and Eric Hartford for their project [laserRMT](https://github.com/cognitivecomputations/laserRMT)
@@ -83,29 +81,11 @@ It recursively sorts the left and right sub-arrays and concatenates the results
83
 
84
  Q4_K_M and Q5_K_M quants are available [here](https://huggingface.co/macadeliccc/laser-dolphin-mixtral-4x7b-dpo-GGUF)
85
 
86
- ![dolphin-cpp-2](dolphin-cpp-2.png)
87
 
88
  ## Eval
89
 
90
- **Models were evaluated in 4bit due to GPU requirements**
91
-
92
- I will evaluate on colab with an A100 asap
93
-
94
- | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
95
- |-------------|-------|------|-----:|--------|-----:|---|-----:|
96
- |arc_challenge|Yaml |none | 0|acc |0.5538|± |0.0145|
97
- | | |none | 0|acc_norm|0.5734|± |0.0145|
98
- |arc_easy |Yaml |none | 0|acc |0.8291|± |0.0077|
99
- | | |none | 0|acc_norm|0.7807|± |0.0085|
100
- |boolq |Yaml |none | 0|acc |0.8694|± |0.0059|
101
- |hellaswag |Yaml |none | 0|acc |0.6402|± |0.0048|
102
- | | |none | 0|acc_norm|0.8233|± |0.0038|
103
- |openbookqa |Yaml |none | 0|acc |0.3380|± |0.0212|
104
- | | |none | 0|acc_norm|0.4720|± |0.0223|
105
- |piqa |Yaml |none | 0|acc |0.8123|± |0.0091|
106
- | | |none | 0|acc_norm|0.8221|± |0.0089|
107
- |winogrande |Yaml |none | 0|acc |0.7348|± |0.0124|
108
-
109
 
110
  ## Citations
111
 
 
4
  ---
5
  # Laser-Dolphin-Mixtral-4x7b-dpo
6
 
 
 
7
  ![laser_dolphin_image](./dolphin_moe.png)
8
 
9
  Credit to Fernando Fernandes and Eric Hartford for their project [laserRMT](https://github.com/cognitivecomputations/laserRMT)
 
81
 
82
  Q4_K_M and Q5_K_M quants are available [here](https://huggingface.co/macadeliccc/laser-dolphin-mixtral-4x7b-dpo-GGUF)
83
 
84
+ ![dolphin-cpp-2](dolphin-cpp-1.png)
85
 
86
  ## Eval
87
 
88
+ **New evaluations in progress**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
89
 
90
  ## Citations
91