Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Alpaca_refine_tuned_gpt2_large-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Alpaca_refine_tuned_gpt2_large-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:625bc0bf7ae9eb48882102a706f0dfff0eb408508a8e487b1eb1bd804040e56a
+size 345513952

Alpaca_refine_tuned_gpt2_large-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4700002a0e4ca5e88e1601f13e478c12f56ce1d9123f6f19fc6dc24b47f10664
+size 493512960

Alpaca_refine_tuned_gpt2_large-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b66fa05b769ae3788e39be24662507b0550054bb75169eef011156bc35c5943
+size 458287360

Alpaca_refine_tuned_gpt2_large-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:48be7d11e7bc30ce11ef3f48500536ea011d0f7c2e8affabe6c472d24b7f9a1d
+size 393980160

Alpaca_refine_tuned_gpt2_large-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d165601de4e0ac63ff7217f3cfeb945f1910316f20e6c3636bf8df538f06af0
+size 496527040

Alpaca_refine_tuned_gpt2_large-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f8c9391e4169732a8ccec9b6530441d8840747f8e2af30e80a503a501297d80
+size 549058240

Alpaca_refine_tuned_gpt2_large-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:844def3e64aff90a148e622f92d840049111ad92f1ecb3afa52f40024bf1329c
+size 499803840

Alpaca_refine_tuned_gpt2_large-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab2dc59df9e329bb39bcc8edc4d951c2cefcea711e455fef643e0d7c5238a5d1
+size 593041760

Alpaca_refine_tuned_gpt2_large-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3756575b04f7082ae7be2d02d87f0fcae5160b0448c556450fdec513c03ca4cb
+size 632209760

Alpaca_refine_tuned_gpt2_large-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:53c18218dc92f87b7f8e8cb7f71b97928b84fc3d3657fd48bf2158c34a42ad5a
+size 593041760

Alpaca_refine_tuned_gpt2_large-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea6466165fb59b915f4578fff1d36b7f96905b55a24b26cfd8a3df550a5ae0c6
+size 695588640

Alpaca_refine_tuned_gpt2_large-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06939baff47fe6c462a9c5b268f12c9a4b92123b09a333c751eba6135e64bf99
+size 898165600

README.md

@@ -0,0 +1,78 @@
+---
+license: apache-2.0
+datasets:
+- tatsu-lab/alpaca
+tags:
+- TensorBlock
+- GGUF
+base_model: LordNoah/Alpaca_refine_tuned_gpt2_large
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## LordNoah/Alpaca_refine_tuned_gpt2_large - GGUF
+
+This repo contains GGUF format model files for [LordNoah/Alpaca_refine_tuned_gpt2_large](https://huggingface.co/LordNoah/Alpaca_refine_tuned_gpt2_large).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [Alpaca_refine_tuned_gpt2_large-Q2_K.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q2_K.gguf) | Q2_K | 0.346 GB | smallest, significant quality loss - not recommended for most purposes |
+| [Alpaca_refine_tuned_gpt2_large-Q3_K_S.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q3_K_S.gguf) | Q3_K_S | 0.394 GB | very small, high quality loss |
+| [Alpaca_refine_tuned_gpt2_large-Q3_K_M.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q3_K_M.gguf) | Q3_K_M | 0.458 GB | very small, high quality loss |
+| [Alpaca_refine_tuned_gpt2_large-Q3_K_L.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q3_K_L.gguf) | Q3_K_L | 0.494 GB | small, substantial quality loss |
+| [Alpaca_refine_tuned_gpt2_large-Q4_0.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q4_0.gguf) | Q4_0 | 0.497 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [Alpaca_refine_tuned_gpt2_large-Q4_K_S.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q4_K_S.gguf) | Q4_K_S | 0.500 GB | small, greater quality loss |
+| [Alpaca_refine_tuned_gpt2_large-Q4_K_M.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q4_K_M.gguf) | Q4_K_M | 0.549 GB | medium, balanced quality - recommended |
+| [Alpaca_refine_tuned_gpt2_large-Q5_0.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q5_0.gguf) | Q5_0 | 0.593 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [Alpaca_refine_tuned_gpt2_large-Q5_K_S.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q5_K_S.gguf) | Q5_K_S | 0.593 GB | large, low quality loss - recommended |
+| [Alpaca_refine_tuned_gpt2_large-Q5_K_M.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q5_K_M.gguf) | Q5_K_M | 0.632 GB | large, very low quality loss - recommended |
+| [Alpaca_refine_tuned_gpt2_large-Q6_K.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q6_K.gguf) | Q6_K | 0.696 GB | very large, extremely low quality loss |
+| [Alpaca_refine_tuned_gpt2_large-Q8_0.gguf](https://huggingface.co/tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF/blob/main/Alpaca_refine_tuned_gpt2_large-Q8_0.gguf) | Q8_0 | 0.898 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF --include "Alpaca_refine_tuned_gpt2_large-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/Alpaca_refine_tuned_gpt2_large-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```