Update README.md
Browse files
README.md
CHANGED
|
@@ -33,7 +33,15 @@ It shoud handle 16-25k context window, maybe 32k.
|
|
| 33 |
|
| 34 |
## Exl2 Quants
|
| 35 |
|
| 36 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
|
| 38 |
## Download
|
| 39 |
|
|
|
|
| 33 |
|
| 34 |
## Exl2 Quants
|
| 35 |
|
| 36 |
+
> [!WARNING]
|
| 37 |
+
>- [4.2bpw-exl2](https://huggingface.co/icefog72/IceNalyvkaRP-7b-4.2bpw-exl2)
|
| 38 |
+
>- [6.5bpw-exl2](https://huggingface.co/icefog72/IceNalyvkaRP-7b-6.5bpw-exl2)
|
| 39 |
+
>- [8bpw-exl2](https://huggingface.co/icefog72/IceNalyvkaRP-7b-8bpw-exl2)
|
| 40 |
+
|
| 41 |
+
## Thx mradermacher for GGUF
|
| 42 |
+
|
| 43 |
+
> [!WARNING]
|
| 44 |
+
>- [GGUF](https://huggingface.co/mradermacher/IceNalyvkaRP-7b-GGUF)
|
| 45 |
|
| 46 |
## Download
|
| 47 |
|