Upload folder using huggingface_hub (#1)

- 152ba291c40fdf56cf1331b3c756248b801b0276e4674dcb5413147bfd066a9a (b39909e7240272c492bd6bd01b8f21259d6eed19)
- 9f85c5f77355ae8d938c6830ea3bc55e5deeb4e6b0f0435e4d0067983541eabc (32e23e0934e8635e45404b49580c90b3da3f2597)
- b39388dbc226809ee78ff50797bc71dc26dfd4c384bddef812c705c729073323 (761140379fa07f7d6dbb53d53e5815bfe9531b8e)
- c6efd46e62ea38adb5803a904a04b942da7a010d47ef9c0f0ca00b83b740bf83 (4ebac9457576fc2b51d58a4f08db97b81e08151e)
- dd3e51ed299f4ec8cfca2524a26a5cb05530f4db9e73242ae63586daf55cabd3 (a12502ba8480169c20cd02977a6fd97d0357774f)
- 8c401371fcb269f3ab279d77597adf339ecf1f1ca37f4148a32b0acbf858126a (9887ffbda7feeb16a311ce4a56c8671992eefe6a)
- b15a6165fbb4398afaa1a6f12ded0efb2d77af16674a1fe067915773a1b440f7 (550cb214413c97810cd3d0b19d316f8b7c09f0e2)
- 8091e4f609a5cbc8c47ae5cfdf0ec7df959b9219bf648d8540631d418243b158 (532a7848b341dd87ecdc14dfe842ed106bffe953)
- eb6b8c6399f70e6688b179bf7204e34579339743450e96f1cf8877f7a8ef131f (644a9ca45babbc87b4de40c5f0c84056212f124c)
- 031c0fb60b4eb073bc2f5ae833ec82b4080c487377788e5f40eccbdeaa7a156f (1342967ecaa02d94a3ed39e2ce06551f9165165f)
- 4fc25ee975c00f638722cf27c0e13f6a4d10fd0bfff513e188c214dda77ace0e (6e83c2e6b4701667ab14b1a110e81c403e6f2c94)

.gitattributes

@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,57 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- llama
+- text-generation
+- mergekit
+- merge
+- conversational
+- base_model:aaditya/Llama3-OpenBioLLM-70B
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: mergekit-passthrough-yqhuxcv-GGUF
+base_model: mergekit-community/mergekit-passthrough-yqhuxcv
+inference: false
+model_creator: mergekit-community
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF)
+- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
+- Original model: [mergekit-community/mergekit-passthrough-yqhuxcv](https://huggingface.co/mergekit-community/mergekit-passthrough-yqhuxcv)
+
+## Description
+[MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF) contains GGUF format model files for [mergekit-community/mergekit-passthrough-yqhuxcv](https://huggingface.co/mergekit-community/mergekit-passthrough-yqhuxcv).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

mergekit-passthrough-yqhuxcv.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d74316e0da3039063d0190552593807f4c79795ab57aad2486ad8a3111551fa9
+size 16887445312

mergekit-passthrough-yqhuxcv.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:337ebe0085eb78cc2bc30c447fc5657d04c02b9521ccc3405b918b0596632912
+size 23708317504

mergekit-passthrough-yqhuxcv.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a11d89db710a06d9a18eddbeccc5e374f1718bb7801c23bb86271d6d9400d9e2
+size 21858629440

mergekit-passthrough-yqhuxcv.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3ec38d21b31b7049519796c9101ea25334fbe1a1d6f3c934e23be290e5fe7090
+size 19707344704

mergekit-passthrough-yqhuxcv.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b57071b41e404bf5ac0c32dc0406ea4135743c31789bfff1ec3ab2b527c600b
+size 27096807232

mergekit-passthrough-yqhuxcv.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:57abf746e9ac31e9ecd1791fa9a5dd21946cea9722828e825b9e3ad58a266b5f
+size 25709213504

mergekit-passthrough-yqhuxcv.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bbba1bcf5ef9477495f2eb4e099ee848579b3e38089a27318dcd8f7137a1e986
+size 31815661376

mergekit-passthrough-yqhuxcv.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55ddbf4549c3bb64364d4855c9ed40cec8fd8ac26d6f7b26d7cacbbb9cf1afb2
+size 31007930176

mergekit-passthrough-yqhuxcv.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1be14240907fd85656021c6442ab41a16b9fe983e341de903113480b16d3cbef
+size 36829443904

mergekit-passthrough-yqhuxcv.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11fe48fe6cd5b50332929ba0efd76b263db4292dac75ccbe84e0d8df5ab16b16
+size 47699605312