MaziyarPanahi commited on
Commit
6a50776
·
verified ·
1 Parent(s): e880828

Upload folder using huggingface_hub (#1)

Browse files

- 3c8681382cbc89a632caaaea7fa9c63259c70b1db9a3b9f9fac419232fbe7b75 (d73f29309aa1ffdfcb54d21fb82df2583d4aba00)
- 4ee3027db1fb57a5b37b267a7dc39e96210b99d2d53443a0e35a3c383e02d114 (db7157daf6371b15c427b3fed3c661f696477619)
- 39c2df7768a84aab97b143ea70ef889beb9b27b6653fe4f83b3456c095e7df93 (d8d18edf3e6a597c071cba8396d6e438599abf5b)
- 318a87fc14c945d7dbbe8411d74cb25d91d6e6a1744ac0c61b02f21ba0daacf9 (4a493ab4139cd44266fe23021ee1edab9ad5bab0)
- 6778e34abec2cf343f9709d375d6e2b36241bbf07e16a66eeadbd85bd1e7c0cf (0bb7fe2c8205e15fcacd4177266e7de51d2b6d9a)
- 309918f2e07e3633bb95b6b7fe11691e5b5ba31f03ac33ffc379152c47f02baf (9b94b93275d7af590b36a474692d7f66218bba23)
- 9fd30a997e568366dbd6d093c2e829bcda48d3bfbdae60b6b20d2bf9e025215c (96ba97c6a4dd604f507357dfe58e50bd159c9af3)
- 5dc7e69944459f28fabba8d64456ce932e31333bfb5e7bdae28c70bd8ab1745d (74c3dbd630f576eea1e78d4eeca17ca92dd36490)
- 511b69b73f64afd4a1ae63e4fdf419626bb76a8bbf3cb9f446821737d92cf0ab (136f8a1d944783f2b3e4880e4978d0f9398c84a8)
- c1502b3399faf9df83ba891aaaaafc8321ad983cb89c9dbe2ea7c4c7c99dbe28 (d052e4c029a8732b5673b6aff7c9ee1121a83666)

.gitattributes CHANGED
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Topsecret.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Topsecret.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Topsecret.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Topsecret.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Topsecret.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Topsecret.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Topsecret.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Topsecret.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Topsecret.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Topsecret.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - transformers
12
+ - safetensors
13
+ - mistral
14
+ - text-generation
15
+ - mergekit
16
+ - merge
17
+ - base_model:NousResearch/Nous-Hermes-2-SOLAR-10.7B
18
+ - base_model:mergekit-community/mergekit-slerp-ebgdloh
19
+ - autotrain_compatible
20
+ - endpoints_compatible
21
+ - text-generation-inference
22
+ - region:us
23
+ - text-generation
24
+ model_name: Topsecret-GGUF
25
+ base_model: mergekit-community/Topsecret
26
+ inference: false
27
+ model_creator: mergekit-community
28
+ pipeline_tag: text-generation
29
+ quantized_by: MaziyarPanahi
30
+ ---
31
+ # [MaziyarPanahi/Topsecret-GGUF](https://huggingface.co/MaziyarPanahi/Topsecret-GGUF)
32
+ - Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
33
+ - Original model: [mergekit-community/Topsecret](https://huggingface.co/mergekit-community/Topsecret)
34
+
35
+ ## Description
36
+ [MaziyarPanahi/Topsecret-GGUF](https://huggingface.co/MaziyarPanahi/Topsecret-GGUF) contains GGUF format model files for [mergekit-community/Topsecret](https://huggingface.co/mergekit-community/Topsecret).
37
+
38
+ ### About GGUF
39
+
40
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
41
+
42
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
43
+
44
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
45
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
46
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
47
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
48
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
49
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
50
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
51
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
52
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
53
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
54
+
55
+ ## Special thanks
56
+
57
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
Topsecret.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fb3268652aafe4fe0ae1401e5f24740dc5eee22e410b983aab9c1811870223b
3
+ size 1756249632
Topsecret.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9578e2a1e72efef1f87307fcfa2e713e8d58c59a7e7300c4e9f1d582561c6b4b
3
+ size 2450480672
Topsecret.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e33b3a15fab6bf20f0d249c6b43a17e9b105ae0f4e34c6c00e410dff34e88e0
3
+ size 2259639840
Topsecret.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4fb903808a52056568d34a752c9da62a1717c1dfc341a9e8472f7c24d2e6061
3
+ size 2039569952
Topsecret.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3446ab9f400b7a18959204529724113877ecf4b6a7825b0cab9546dd35561340
3
+ size 2798517792
Topsecret.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d12da472efdcee3bf77a660d31b5516d1b73d670b0c6e198b4883ad21efce8d3
3
+ size 2653093408
Topsecret.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70556cd8a7ae308fd0a2b915c084a00e7214568df166bdae889751ef0d7a31a2
3
+ size 3281518112
Topsecret.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76597c999a17fea9172a59c324ad7f941159747458d310b80d64456b354b4922
3
+ size 3197959712
Topsecret.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f077601b5e4a853ad25e4cbe19d848334e0729a9b8b55376f8edeae7e1ae01d0
3
+ size 3794705952
Topsecret.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8aecd35503fed1d5a51a89ef24b9c8b5c8532f804d8da492148a61d5b3789838
3
+ size 4914634272