Update README.md
Browse files
README.md
CHANGED
|
@@ -175,63 +175,38 @@ missing : 1.26%
|
|
| 175 |
Here are the results for [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx) vs [model_uint8.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_uint8.onnx):
|
| 176 |
|
| 177 |
```
|
| 178 |
-
|
| 179 |
-
exact : 20.54%
|
| 180 |
-
off by 1 : 13.79%
|
| 181 |
-
off by 2 : 8.55%
|
| 182 |
-
off by 3 : 6.37%
|
| 183 |
-
off by 4 : 4.87%
|
| 184 |
-
off by 5+: 31.53%
|
| 185 |
-
missing : 14.34%
|
| 186 |
-
|
| 187 |
-
Stats for top 20 query results across entire token range:
|
| 188 |
-
exact : 11.58%
|
| 189 |
-
off by 1 : 9.46%
|
| 190 |
-
off by 2 : 6.76%
|
| 191 |
-
off by 3 : 5.58%
|
| 192 |
-
off by 4 : 4.70%
|
| 193 |
-
off by 5+: 38.80%
|
| 194 |
-
missing : 23.12%
|
| 195 |
-
|
| 196 |
-
Stats for top 50 query results across entire token range:
|
| 197 |
-
exact : 5.34%
|
| 198 |
-
off by 1 : 5.18%
|
| 199 |
-
off by 2 : 4.09%
|
| 200 |
-
off by 3 : 3.60%
|
| 201 |
-
off by 4 : 3.22%
|
| 202 |
-
off by 5+: 36.17%
|
| 203 |
-
missing : 42.38%
|
| 204 |
```
|
| 205 |
|
| 206 |
Here are the results for [model.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model.onnx) vs [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx):
|
| 207 |
|
| 208 |
```
|
| 209 |
-
|
| 210 |
-
exact :
|
| 211 |
-
off by 1 :
|
| 212 |
-
off by 2 :
|
| 213 |
-
off by 3 :
|
| 214 |
-
off by 4 :
|
| 215 |
-
off by 5+:
|
| 216 |
-
missing :
|
| 217 |
|
| 218 |
Stats for top 20 query results across entire token range:
|
| 219 |
-
exact :
|
| 220 |
-
off by 1 :
|
| 221 |
-
off by 2 :
|
| 222 |
-
off by 3 :
|
| 223 |
-
off by 4 :
|
| 224 |
-
off by 5+:
|
| 225 |
-
missing :
|
| 226 |
|
| 227 |
Stats for top 50 query results across entire token range:
|
| 228 |
-
exact :
|
| 229 |
-
off by 1 :
|
| 230 |
-
off by 2 : 3.
|
| 231 |
-
off by 3 :
|
| 232 |
-
off by 4 :
|
| 233 |
-
off by 5+:
|
| 234 |
-
missing :
|
| 235 |
```
|
| 236 |
# Example inference code
|
| 237 |
|
|
|
|
| 175 |
Here are the results for [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx) vs [model_uint8.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_uint8.onnx):
|
| 176 |
|
| 177 |
```
|
| 178 |
+
rechecking ...
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 179 |
```
|
| 180 |
|
| 181 |
Here are the results for [model.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model.onnx) vs [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx):
|
| 182 |
|
| 183 |
```
|
| 184 |
+
tats for top 10 query results across entire token range:
|
| 185 |
+
exact : 86.65%
|
| 186 |
+
off by 1 : 12.45%
|
| 187 |
+
off by 2 : 0.44%
|
| 188 |
+
off by 3 : 0.06%
|
| 189 |
+
off by 4 : 0.01%
|
| 190 |
+
off by 5+: 0.01%
|
| 191 |
+
missing : 0.38%
|
| 192 |
|
| 193 |
Stats for top 20 query results across entire token range:
|
| 194 |
+
exact : 83.34%
|
| 195 |
+
off by 1 : 14.81%
|
| 196 |
+
off by 2 : 1.11%
|
| 197 |
+
off by 3 : 0.20%
|
| 198 |
+
off by 4 : 0.05%
|
| 199 |
+
off by 5+: 0.03%
|
| 200 |
+
missing : 0.47%
|
| 201 |
|
| 202 |
Stats for top 50 query results across entire token range:
|
| 203 |
+
exact : 75.57%
|
| 204 |
+
off by 1 : 19.34%
|
| 205 |
+
off by 2 : 3.08%
|
| 206 |
+
off by 3 : 0.85%
|
| 207 |
+
off by 4 : 0.28%
|
| 208 |
+
off by 5+: 0.19%
|
| 209 |
+
missing : 0.69%
|
| 210 |
```
|
| 211 |
# Example inference code
|
| 212 |
|