Upload README.md

README.md

@@ -1,13 +1,24 @@
-# GGUF of featherless-ai/Qwerky-QwQ-32B
-
-Created using llama.cpp (b5013)[https://github.com/ggml-org/llama.cpp/releases/tag/b5013] with required fixes merged.
-
 ---
 thumbnail: https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/OufWyNMKYRozfC8j8S-M8.png
+quantized_by: latentWanderer
+pipeline_tag: text-generation
 license: apache-2.0
-library_name: transformers
+license_link: https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md
+base_model: featherless-ai/Qwerky-QwQ-32B
+tags:
+- chat
+language:
+- en
 ---
 
+# GGUF of [featherless-ai/Qwerky-QwQ-32B](https://huggingface.co/featherless-ai/Qwerky-QwQ-32B)
+
+Created using llama.cpp [b5013](https://github.com/ggml-org/llama.cpp/releases/tag/b5013) with required fixes merged.
+
+All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8). The imatrix is included.
+
+The model is only trained with 8k context, expect degraded performance past that.
+
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/633e85093a17ab61de8d9073/OufWyNMKYRozfC8j8S-M8.png)
 
 - Try out the model on [![Featherless](https://img.shields.io/badge/featherless--ai%2FQwerky--QwQ--32B-Dummy?style=flat&label=Featherless&color=facc15)](https://featherless.ai/models/featherless-ai/Qwerky-QwQ-32B)