Rename README.md

README.md

@@ -0,0 +1,14 @@
+
+A set of 50% weight-sparse Llama3.1-8B pruned by [Wanda](https://github.com/locuslab/wanda).
+Model links are in the table below. Models can be loaded as is with Huggingface Transformers.
+
+### Perplexity
+![Perplexity over Sparsity](llama3.1-8B_Wanda_sparsity.png)
+### MMLU (5-shot)
+| MMLU (5-shot)  | Accuracy (%) | Relative to Dense (%) | Model Link|
+|----------------|--------------|-----------------------|-----------|
+| Dense          | 65.1         | baseline              | [Meta-Llama-3.1-8B-wanda-unstructured-0.0](https://huggingface.co/vuiseng9/Meta-Llama-3.1-8B-wanda-unstructured-0.0) |
+| Unstructured   | 50.0         | -15.1                 | [Meta-Llama-3.1-8B-wanda-unstructured-0.5](https://huggingface.co/vuiseng9/Meta-Llama-3.1-8B-wanda-unstructured-0.5) |
+| 4:8            | 39.3         | -25.8                 | [Meta-Llama-3.1-8B-wanda-4of8](https://huggingface.co/vuiseng9/Meta-Llama-3.1-8B-wanda-4of8) |
+| 2:4            | 28.7         | -36.4                 | [Meta-Llama-3.1-8B-wanda-2of4](https://huggingface.co/vuiseng9/Meta-Llama-3.1-8B-wanda-2of4) |
+