Upload folder using huggingface_hub
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ base_model: ibm-granite/granite-3.1-8b-instruct
|
|
26 |
|
27 |
This repo contains GGUF format model files for [ibm-granite/granite-3.1-8b-instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct).
|
28 |
|
29 |
-
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit
|
30 |
|
31 |
<div style="text-align: left; margin: 20px 0;">
|
32 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
|
|
26 |
|
27 |
This repo contains GGUF format model files for [ibm-granite/granite-3.1-8b-instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct).
|
28 |
|
29 |
+
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4391](https://github.com/ggerganov/llama.cpp/commit/9ba399dfa7f115effc63d48e6860a94c9faa31b2).
|
30 |
|
31 |
<div style="text-align: left; margin: 20px 0;">
|
32 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|