roleplaiapp commited on
Commit
e4ae082
·
verified ·
1 Parent(s): 11d7681

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-generation
4
+ tags:
5
+ - arxivllama
6
+ - f16
7
+ - gguf
8
+ - llama-cpp
9
+ - text-generation
10
+ ---
11
+
12
+ # roleplaiapp/ArxivLlama-3.1-8B-f16-GGUF
13
+
14
+ **Repo:** `roleplaiapp/ArxivLlama-3.1-8B-f16-GGUF`
15
+ **Original Model:** `ArxivLlama-3.1-8B`
16
+ **Quantized File:** `ArxivLlama-3.1-8B.f16.gguf`
17
+ **Quantization:** `GGUF`
18
+ **Quantization Method:** `f16`
19
+
20
+ ## Overview
21
+ This is a GGUF f16 quantized version of ArxivLlama-3.1-8B
22
+ ## Quantization By
23
+ I often have idle GPUs while building/testing for the RP app, so I put them to use quantizing models.
24
+ I hope the community finds these quantizations useful.
25
+
26
+ Andrew Webby @ [RolePlai](https://roleplai.app/).