shaowenchen
/

vicuna-13b-v1.5-16k-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

shaowenchen commited on Sep 12, 2023

Commit

cf53f37

·

1 Parent(s): 188229c

add images to readme

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -50,9 +50,9 @@ and you can view http://localhost:8000/docs to see the swagger UI.
 | Name                                        | Quant method | Compressed Size |
 | ------------------------------------------- | ------------ | --------------- |
-| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q2_K` | Q2_K         | 2.88 GB         |
-| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q3_K` | Q3_K         | 3.3 GB          |
-| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q4_K` | Q4_K         | 4 GB            |
 Usage:

 | Name                                        | Quant method | Compressed Size |
 | ------------------------------------------- | ------------ | --------------- |
+| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q2_K` | Q2_K         | 5.29 GB         |
+| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q3_K` | Q3_K         | 6.11 GB         |
+| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q4_K` | Q4_K         | 7.47 GB         |
 Usage: