GGUF
File size: 1,101 Bytes
2f0bf35
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
---
inference: false
license: unlicense
---

[[Request #54]](https://huggingface.co/Lewdiculous/Model-Requests/discussions/54) - Click the link for more context. <br>
[concedo/KobbleTinyV2-1.1B](https://huggingface.co/concedo/KobbleTinyV2-1.1B) <br>

Use with the [**latest version of KoboldCpp**](https://github.com/LostRuins/koboldcpp/releases/latest), or [this more up-to-date fork](https://github.com/Nexesenex/kobold.cpp) if you have issues. 

<details>
<summary>⇲ Click here to expand/hide information – General chart with relative quant parformances.</summary> 

> [!NOTE]
> **Recommended read:** <br>
> 
> [**"Which GGUF is right for me? (Opinionated)" by Artefact2**](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
> 
> *Click the image to view full size.*
> !["Which GGUF is right for me? (Opinionated)" by Artefact2 - Firs Graph](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/fScWdHIPix5IzNJ8yswCB.webp)

</details>

![image](https://cdn-uploads.huggingface.co/production/uploads/660942fd0b7d615a5672ded9/h1MmQc94Oxbw91O2TkvU-.jpeg)