brooketh commited on
Commit
6d2b5a0
·
verified ·
1 Parent(s): 4a8e707

Upload WizardLM-2-8x22B-GGUF.

Browse files
Files changed (2) hide show
  1. README.md +4 -3
  2. WizardLM-2-8x22B.imatrix +2 -2
README.md CHANGED
@@ -14,11 +14,12 @@ quantized_by: brooketh
14
 
15
  ***
16
  # WizardLM 2 8x22B
17
- - **Creator:** [Microsoft](https://huggingface.co/Microsoft/)
18
- - **Original:** [WizardLM 2 8x22B](https://huggingface.co/alpindale/WizardLM-2-8x22B)
19
  - **Date Created:** 2024-04-16
20
  - **Trained Context:** 65536 tokens
21
- - **Description:** WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model, focused on complex chat and reasoning. It claims highly competitive performance compared to leading proprietary models.
 
22
  ## What is a GGUF?
23
  GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Faraday.dev. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
24
  GGUF models are quantized to reduce resource usage, with a tradeoff of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.
 
14
 
15
  ***
16
  # WizardLM 2 8x22B
17
+ - **Creator:** [alpindale](https://huggingface.co/alpindale/)
18
+ - **Original:** [WizardLM 2 8x22B](https://huggingface.co/models/base/WizardLM-2-8x22B)
19
  - **Date Created:** 2024-04-16
20
  - **Trained Context:** 65536 tokens
21
+ - **Description:** (Add description here)
22
+
23
  ## What is a GGUF?
24
  GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Faraday.dev. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
25
  GGUF models are quantized to reduce resource usage, with a tradeoff of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.
WizardLM-2-8x22B.imatrix CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:382700ef5488a258e1fc8412f2ee73306dc5089939e485b8b73f4390b004fcb6
3
- size 58318282
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06f5e233ffd144766f69e47f33e56d867f4c0be082a3f2991308955f16255353
3
+ size 58277471