Upload folder using huggingface_hub (#1)
Browse files- 3c8681382cbc89a632caaaea7fa9c63259c70b1db9a3b9f9fac419232fbe7b75 (d73f29309aa1ffdfcb54d21fb82df2583d4aba00)
- 4ee3027db1fb57a5b37b267a7dc39e96210b99d2d53443a0e35a3c383e02d114 (db7157daf6371b15c427b3fed3c661f696477619)
- 39c2df7768a84aab97b143ea70ef889beb9b27b6653fe4f83b3456c095e7df93 (d8d18edf3e6a597c071cba8396d6e438599abf5b)
- 318a87fc14c945d7dbbe8411d74cb25d91d6e6a1744ac0c61b02f21ba0daacf9 (4a493ab4139cd44266fe23021ee1edab9ad5bab0)
- 6778e34abec2cf343f9709d375d6e2b36241bbf07e16a66eeadbd85bd1e7c0cf (0bb7fe2c8205e15fcacd4177266e7de51d2b6d9a)
- 309918f2e07e3633bb95b6b7fe11691e5b5ba31f03ac33ffc379152c47f02baf (9b94b93275d7af590b36a474692d7f66218bba23)
- 9fd30a997e568366dbd6d093c2e829bcda48d3bfbdae60b6b20d2bf9e025215c (96ba97c6a4dd604f507357dfe58e50bd159c9af3)
- 5dc7e69944459f28fabba8d64456ce932e31333bfb5e7bdae28c70bd8ab1745d (74c3dbd630f576eea1e78d4eeca17ca92dd36490)
- 511b69b73f64afd4a1ae63e4fdf419626bb76a8bbf3cb9f446821737d92cf0ab (136f8a1d944783f2b3e4880e4978d0f9398c84a8)
- c1502b3399faf9df83ba891aaaaafc8321ad983cb89c9dbe2ea7c4c7c99dbe28 (d052e4c029a8732b5673b6aff7c9ee1121a83666)
- .gitattributes +10 -0
- README.md +57 -0
- Topsecret.Q2_K.gguf +3 -0
- Topsecret.Q3_K_L.gguf +3 -0
- Topsecret.Q3_K_M.gguf +3 -0
- Topsecret.Q3_K_S.gguf +3 -0
- Topsecret.Q4_K_M.gguf +3 -0
- Topsecret.Q4_K_S.gguf +3 -0
- Topsecret.Q5_K_M.gguf +3 -0
- Topsecret.Q5_K_S.gguf +3 -0
- Topsecret.Q6_K.gguf +3 -0
- Topsecret.Q8_0.gguf +3 -0
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
Topsecret.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
Topsecret.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
Topsecret.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
Topsecret.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
Topsecret.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
Topsecret.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
42 |
+
Topsecret.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
43 |
+
Topsecret.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
+
Topsecret.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
+
Topsecret.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- quantized
|
4 |
+
- 2-bit
|
5 |
+
- 3-bit
|
6 |
+
- 4-bit
|
7 |
+
- 5-bit
|
8 |
+
- 6-bit
|
9 |
+
- 8-bit
|
10 |
+
- GGUF
|
11 |
+
- transformers
|
12 |
+
- safetensors
|
13 |
+
- mistral
|
14 |
+
- text-generation
|
15 |
+
- mergekit
|
16 |
+
- merge
|
17 |
+
- base_model:NousResearch/Nous-Hermes-2-SOLAR-10.7B
|
18 |
+
- base_model:mergekit-community/mergekit-slerp-ebgdloh
|
19 |
+
- autotrain_compatible
|
20 |
+
- endpoints_compatible
|
21 |
+
- text-generation-inference
|
22 |
+
- region:us
|
23 |
+
- text-generation
|
24 |
+
model_name: Topsecret-GGUF
|
25 |
+
base_model: mergekit-community/Topsecret
|
26 |
+
inference: false
|
27 |
+
model_creator: mergekit-community
|
28 |
+
pipeline_tag: text-generation
|
29 |
+
quantized_by: MaziyarPanahi
|
30 |
+
---
|
31 |
+
# [MaziyarPanahi/Topsecret-GGUF](https://huggingface.co/MaziyarPanahi/Topsecret-GGUF)
|
32 |
+
- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
|
33 |
+
- Original model: [mergekit-community/Topsecret](https://huggingface.co/mergekit-community/Topsecret)
|
34 |
+
|
35 |
+
## Description
|
36 |
+
[MaziyarPanahi/Topsecret-GGUF](https://huggingface.co/MaziyarPanahi/Topsecret-GGUF) contains GGUF format model files for [mergekit-community/Topsecret](https://huggingface.co/mergekit-community/Topsecret).
|
37 |
+
|
38 |
+
### About GGUF
|
39 |
+
|
40 |
+
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
|
41 |
+
|
42 |
+
Here is an incomplete list of clients and libraries that are known to support GGUF:
|
43 |
+
|
44 |
+
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
45 |
+
* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
|
46 |
+
* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
|
47 |
+
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|
48 |
+
* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
|
49 |
+
* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
|
50 |
+
* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
|
51 |
+
* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
|
52 |
+
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
53 |
+
* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
|
54 |
+
|
55 |
+
## Special thanks
|
56 |
+
|
57 |
+
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0fb3268652aafe4fe0ae1401e5f24740dc5eee22e410b983aab9c1811870223b
|
3 |
+
size 1756249632
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9578e2a1e72efef1f87307fcfa2e713e8d58c59a7e7300c4e9f1d582561c6b4b
|
3 |
+
size 2450480672
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8e33b3a15fab6bf20f0d249c6b43a17e9b105ae0f4e34c6c00e410dff34e88e0
|
3 |
+
size 2259639840
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e4fb903808a52056568d34a752c9da62a1717c1dfc341a9e8472f7c24d2e6061
|
3 |
+
size 2039569952
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3446ab9f400b7a18959204529724113877ecf4b6a7825b0cab9546dd35561340
|
3 |
+
size 2798517792
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d12da472efdcee3bf77a660d31b5516d1b73d670b0c6e198b4883ad21efce8d3
|
3 |
+
size 2653093408
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:70556cd8a7ae308fd0a2b915c084a00e7214568df166bdae889751ef0d7a31a2
|
3 |
+
size 3281518112
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:76597c999a17fea9172a59c324ad7f941159747458d310b80d64456b354b4922
|
3 |
+
size 3197959712
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f077601b5e4a853ad25e4cbe19d848334e0729a9b8b55376f8edeae7e1ae01d0
|
3 |
+
size 3794705952
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8aecd35503fed1d5a51a89ef24b9c8b5c8532f804d8da492148a61d5b3789838
|
3 |
+
size 4914634272
|