Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+mergekit-passthrough-yqhuxcv.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,57 @@
+---
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- transformers
+- safetensors
+- llama
+- text-generation
+- mergekit
+- merge
+- conversational
+- base_model:aaditya/Llama3-OpenBioLLM-70B
+- autotrain_compatible
+- endpoints_compatible
+- text-generation-inference
+- region:us
+- text-generation
+model_name: mergekit-passthrough-yqhuxcv-GGUF
+base_model: mergekit-community/mergekit-passthrough-yqhuxcv
+inference: false
+model_creator: mergekit-community
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+---
+# [MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF)
+- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
+- Original model: [mergekit-community/mergekit-passthrough-yqhuxcv](https://huggingface.co/mergekit-community/mergekit-passthrough-yqhuxcv)
+
+## Description
+[MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-yqhuxcv-GGUF) contains GGUF format model files for [mergekit-community/mergekit-passthrough-yqhuxcv](https://huggingface.co/mergekit-community/mergekit-passthrough-yqhuxcv).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

mergekit-passthrough-yqhuxcv.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d74316e0da3039063d0190552593807f4c79795ab57aad2486ad8a3111551fa9
+size 16887445312

mergekit-passthrough-yqhuxcv.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:337ebe0085eb78cc2bc30c447fc5657d04c02b9521ccc3405b918b0596632912
+size 23708317504

mergekit-passthrough-yqhuxcv.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a11d89db710a06d9a18eddbeccc5e374f1718bb7801c23bb86271d6d9400d9e2
+size 21858629440

mergekit-passthrough-yqhuxcv.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3ec38d21b31b7049519796c9101ea25334fbe1a1d6f3c934e23be290e5fe7090
+size 19707344704

mergekit-passthrough-yqhuxcv.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b57071b41e404bf5ac0c32dc0406ea4135743c31789bfff1ec3ab2b527c600b
+size 27096807232

mergekit-passthrough-yqhuxcv.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:57abf746e9ac31e9ecd1791fa9a5dd21946cea9722828e825b9e3ad58a266b5f
+size 25709213504

mergekit-passthrough-yqhuxcv.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bbba1bcf5ef9477495f2eb4e099ee848579b3e38089a27318dcd8f7137a1e986
+size 31815661376

mergekit-passthrough-yqhuxcv.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55ddbf4549c3bb64364d4855c9ed40cec8fd8ac26d6f7b26d7cacbbb9cf1afb2
+size 31007930176

mergekit-passthrough-yqhuxcv.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1be14240907fd85656021c6442ab41a16b9fe983e341de903113480b16d3cbef
+size 36829443904

mergekit-passthrough-yqhuxcv.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11fe48fe6cd5b50332929ba0efd76b263db4292dac75ccbe84e0d8df5ab16b16
+size 47699605312