neuralmagic
/

Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

alexmarques commited on Oct 10, 2024

Commit

7389db8

·

verified ·

1 Parent(s): 3f1f2d2

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -256,7 +256,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>MMLU-Pro
    </td>
    <td>48.1
    </td>
@@ -266,7 +266,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>IFEval
    </td>
    <td>86.4
    </td>
@@ -276,7 +276,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>BBH
    </td>
    <td>55.8
    </td>
@@ -286,7 +286,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>Math |v| 5
    </td>
    <td>26.1
    </td>
@@ -296,7 +296,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>GPQA ()
    </td>
    <td>15.4
    </td>
@@ -306,7 +306,7 @@ Detailed model outputs are available as HuggingFace datasets for [Arena-Hard](ht
    </td>
   </tr>
   <tr>
-   <td>MuSR (5-shot)
    </td>
    <td>18.2
    </td>

    </td>
   </tr>
   <tr>
+   <td>MMLU-Pro (5-shot)
    </td>
    <td>48.1
    </td>
    </td>
   </tr>
   <tr>
+   <td>IFEval (0-shot)
    </td>
    <td>86.4
    </td>
    </td>
   </tr>
   <tr>
+   <td>BBH (3-shot)
    </td>
    <td>55.8
    </td>
    </td>
   </tr>
   <tr>
+   <td>Math-|v|-5 (4-shot)
    </td>
    <td>26.1
    </td>
    </td>
   </tr>
   <tr>
+   <td>GPQA (0-shot)
    </td>
    <td>15.4
    </td>
    </td>
   </tr>
   <tr>
+   <td>MuSR (0-shot)
    </td>
    <td>18.2
    </td>