diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000000000000000000000000000000000000..e79ce6a89353fed9e05c6bd0e566fbd82c8d6d5f --- /dev/null +++ b/.gitattributes @@ -0,0 +1,36 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +*.gguf filter=lfs diff=lfs merge=lfs -text \ No newline at end of file diff --git a/LICENSE b/LICENSE new file mode 100644 index 0000000000000000000000000000000000000000..352f53dbc8354f63d7eaddeade0bfa5960dd40cf --- /dev/null +++ b/LICENSE @@ -0,0 +1,198 @@ + + Apache License + Version 2.0, January 2004 + http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + (except as stated in this section) patent license to make, have made, + use, offer to sell, sell, import, and otherwise transfer the Work, + where such license applies only to those patent claims licensable + by such Contributor that are necessarily infringed by their + Contribution(s) alone or by combination of their Contribution(s) + with the Work to which such Contribution(s) was submitted. If You + institute patent litigation against any entity (including a + cross-claim or counterclaim in a lawsuit) alleging that the Work + or a Contribution incorporated within the Work constitutes direct + or contributory patent infringement, then any patent licenses + granted to You under this License for that Work shall terminate + as of the date such litigation is filed. + + 4. Redistribution. You may reproduce and distribute copies of the + Work or Derivative Works thereof in any medium, with or without + modifications, and in Source or Object form, provided that You + meet the following conditions: + + (a) You must give any other recipients of the Work or + Derivative Works a copy of this License; and + + (b) You must cause any modified files to carry prominent notices + stating that You changed the files; and + + (c) You must retain, in the Source form of any Derivative Works + that You distribute, all copyright, patent, trademark, and + attribution notices from the Source form of the Work, + excluding those notices that do not pertain to any part of + the Derivative Works; and + + (d) If the Work includes a "NOTICE" text file as part of its + distribution, then any Derivative Works that You distribute must + include a readable copy of the attribution notices contained + within such NOTICE file, excluding those notices that do not + pertain to any part of the Derivative Works, in at least one + of the following places: within a NOTICE text file distributed + as part of the Derivative Works; within the Source form or + documentation, if provided along with the Derivative Works; or, + within a display generated by the Derivative Works, if and + wherever such third-party notices normally appear. The contents + of the NOTICE file are for informational purposes only and + do not modify the License. You may add Your own attribution + notices within Derivative Works that You distribute, alongside + or as an addendum to the NOTICE text from the Work, provided + that such additional attribution notices cannot be construed + as modifying the License. + + You may add Your own copyright statement to Your modifications and + may provide additional or different license terms and conditions + for use, reproduction, or distribution of Your modifications, or + for any such Derivative Works as a whole, provided Your use, + reproduction, and distribution of the Work otherwise complies with + the conditions stated in this License. + + 5. Submission of Contributions. Unless You explicitly state otherwise, + any Contribution intentionally submitted for inclusion in the Work + by You to the Licensor shall be under the terms and conditions of + this License, without any additional terms or conditions. + Notwithstanding the above, nothing herein shall supersede or modify + the terms of any separate license agreement you may have executed + with Licensor regarding such Contributions. + + 6. Trademarks. This License does not grant permission to use the trade + names, trademarks, service marks, or product names of the Licensor, + except as required for reasonable and customary use in describing the + origin of the Work and reproducing the content of the NOTICE file. + + 7. Disclaimer of Warranty. Unless required by applicable law or + agreed to in writing, Licensor provides the Work (and each + Contributor provides its Contributions) on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or + implied, including, without limitation, any warranties or conditions + of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A + PARTICULAR PURPOSE. You are solely responsible for determining the + appropriateness of using or redistributing the Work and assume any + risks associated with Your exercise of permissions under this License. + + 8. Limitation of Liability. In no event and under no legal theory, + whether in tort (including negligence), contract, or otherwise, + unless required by applicable law (such as deliberate and grossly + negligent acts) or agreed to in writing, shall any Contributor be + liable to You for damages, including any direct, indirect, special, + incidental, or consequential damages of any character arising as a + result of this License or out of the use or inability to use the + Work (including but not limited to damages for loss of goodwill, + work stoppage, computer failure or malfunction, or any and all + other commercial damages or losses), even if such Contributor + has been advised of the possibility of such damages. + + 9. Accepting Warranty or Additional Liability. While redistributing + the Work or Derivative Works thereof, You may choose to offer, + and charge a fee for, acceptance of support, warranty, indemnity, + or other liability obligations and/or rights consistent with this + License. However, in accepting such obligations, You may act only + on Your own behalf and on Your sole responsibility, not on behalf + of any other Contributor, and only if You agree to indemnify, + defend, and hold each Contributor harmless for any liability + incurred by, or claims asserted against, such Contributor by reason + of your accepting any such warranty or additional liability. + + END OF TERMS AND CONDITIONS + + APPENDIX: How to apply the Apache License to your work. + + To apply the Apache License to your work, attach the following + boilerplate notice, with the fields enclosed by brackets "[]" + replaced with your own identifying information. (Don't include + the brackets!) The text should be enclosed in the appropriate + comment syntax for the file format. We also recommend that a + file or class name and description of purpose be included on the + same "printed page" as the copyright notice for easier + identification within third-party archives. + Copyright 2024 Alibaba Cloud + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + http://www.apache.org/licenses/LICENSE-2.0 + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. \ No newline at end of file diff --git a/qwq-32b-fp16-00001-of-00017.gguf b/qwq-32b-fp16-00001-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..19d440d6778d627c9e3f8073ca41f1b3a2523a36 --- /dev/null +++ b/qwq-32b-fp16-00001-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77de6b1ad4e432182c30f76f1c7ec97cffd6de8a5f54fae5ed0c761df0b7edf3 +size 3922555872 diff --git a/qwq-32b-fp16-00002-of-00017.gguf b/qwq-32b-fp16-00002-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..96e32c728f947d3dea1d7832c7c1fd6823c4dec5 --- /dev/null +++ b/qwq-32b-fp16-00002-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30d54990163af5933a9a405c98fd74b96940c1b83c17edd4432f2761919608c0 +size 3900963552 diff --git a/qwq-32b-fp16-00003-of-00017.gguf b/qwq-32b-fp16-00003-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..1a9b30e34f78bc7b7ded64cf90c1c3cb543d5456 --- /dev/null +++ b/qwq-32b-fp16-00003-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:62131f611e0e24fd9a10ccd20912ce7e2329ce6e129e764cb9219af4419c0eba +size 3901004608 diff --git a/qwq-32b-fp16-00004-of-00017.gguf b/qwq-32b-fp16-00004-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..9d93b9b83483fa2e05ac406d19d89ce3fb8e4ea9 --- /dev/null +++ b/qwq-32b-fp16-00004-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ab9730d28167b7c64c0eba91b1c95637eb88bcfc56df3e482cd5b6e9334aac0 +size 3900984128 diff --git a/qwq-32b-fp16-00005-of-00017.gguf b/qwq-32b-fp16-00005-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4ad0b12cf6952715cb8b4d953ed0f3960d0197cd --- /dev/null +++ b/qwq-32b-fp16-00005-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:32eae894fecae35c1cbb6c66279f64f307ebaa12eb8bd6888d6cd2832f956173 +size 3900984128 diff --git a/qwq-32b-fp16-00006-of-00017.gguf b/qwq-32b-fp16-00006-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..beb608a94dc58d7b285203fadf6f46507d68fb91 --- /dev/null +++ b/qwq-32b-fp16-00006-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd1a45849e83e372ddd93b6f48b000cede6399ae710e2be6f4d6e00d65693b0e +size 3900984128 diff --git a/qwq-32b-fp16-00007-of-00017.gguf b/qwq-32b-fp16-00007-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..acb78edbc2ae902698be1d29c267de9589ee8d65 --- /dev/null +++ b/qwq-32b-fp16-00007-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0033cb9ea329571b01e8ff04b11e049a6a126850938911fc80692bda45da8e08 +size 3900984128 diff --git a/qwq-32b-fp16-00008-of-00017.gguf b/qwq-32b-fp16-00008-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..edcfaf3e922a524575df9e9f2903a17545f3d2f5 --- /dev/null +++ b/qwq-32b-fp16-00008-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d72e594cf4a8e49fbdac59a4fc55e98c3637187298841a7b60e07f3e9760fe7b +size 3900984128 diff --git a/qwq-32b-fp16-00009-of-00017.gguf b/qwq-32b-fp16-00009-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ca53e850864f2124bd47e9da7b7527f9793073bf --- /dev/null +++ b/qwq-32b-fp16-00009-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:36b34e5163fc6afceb0021c75cc58ae1c46af0c96de4465e262541e6f4dcb9da +size 3900984128 diff --git a/qwq-32b-fp16-00010-of-00017.gguf b/qwq-32b-fp16-00010-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..cf26311192ed6a44c4add225e31933d7153d2f27 --- /dev/null +++ b/qwq-32b-fp16-00010-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:579a9d3f54b330133e2e43f9db454a31215f40c686ad143b1f87276bb23f4481 +size 3900984128 diff --git a/qwq-32b-fp16-00011-of-00017.gguf b/qwq-32b-fp16-00011-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a3cb8482f16000ca7941ded8b57a4987ac2014a5 --- /dev/null +++ b/qwq-32b-fp16-00011-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4b7dab793ca8fb8268884fcad845db2becbcffc124ed9d7fb9b577be5ec1af6f +size 3900984128 diff --git a/qwq-32b-fp16-00012-of-00017.gguf b/qwq-32b-fp16-00012-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..1f998890c8a95acc0bbaa2f80be750738a3e0e20 --- /dev/null +++ b/qwq-32b-fp16-00012-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:352df0060e398a17851a9d1fbad50087f5fe4b58fc0f58d84527e27c2dcc22af +size 3900984128 diff --git a/qwq-32b-fp16-00013-of-00017.gguf b/qwq-32b-fp16-00013-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..96d199f80b2740c39df27acc25ab220205cf054f --- /dev/null +++ b/qwq-32b-fp16-00013-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb11cac2acd5e29717b860fc6f00fedd23912bd0a4cd9e2f20e65e45036d88ce +size 3900984128 diff --git a/qwq-32b-fp16-00014-of-00017.gguf b/qwq-32b-fp16-00014-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..00873cd4e1fe4043f5d57a56e9cb8df60bc943ed --- /dev/null +++ b/qwq-32b-fp16-00014-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:587053e3c66713c82a19f00faa40b933977fedb8661acb099f5938512a353cc0 +size 3900984128 diff --git a/qwq-32b-fp16-00015-of-00017.gguf b/qwq-32b-fp16-00015-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..693f7bb085fe97b3f9f2a5d54b8fb68e241fb9cd --- /dev/null +++ b/qwq-32b-fp16-00015-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a51481916ddc29baf38439ea37b4578ea14717aaf70b7eab382cb79d33792de0 +size 3900984128 diff --git a/qwq-32b-fp16-00016-of-00017.gguf b/qwq-32b-fp16-00016-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..c0275b546857a101e91ba6e43f1ab8b35cc917d5 --- /dev/null +++ b/qwq-32b-fp16-00016-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e0a2c8115ad2ca45d4b3d16505b2c97f9339e7e7785373234306dc45757eb94 +size 3900963584 diff --git a/qwq-32b-fp16-00017-of-00017.gguf b/qwq-32b-fp16-00017-of-00017.gguf new file mode 100644 index 0000000000000000000000000000000000000000..55dc8fd193b141d573d929503feb4a9d96d5bfb9 --- /dev/null +++ b/qwq-32b-fp16-00017-of-00017.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0753b393f563ea5f472d4913fc0083a5ce046a2b4b20bbc6dd940719253dcb1a +size 3098674304 diff --git a/qwq-32b-q2_k-00001-of-00004.gguf b/qwq-32b-q2_k-00001-of-00004.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3a10cc49a997ab9e6dd77f38f1eebeb42883b941 --- /dev/null +++ b/qwq-32b-q2_k-00001-of-00004.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ae85d0df855da81c3cec5825c6c1eddbcf2236bfe79f4a16c724efc79ef0ebfd +size 4003345504 diff --git a/qwq-32b-q2_k-00002-of-00004.gguf b/qwq-32b-q2_k-00002-of-00004.gguf new file mode 100644 index 0000000000000000000000000000000000000000..2458787dffc47cbc7e1822bbf7cf08f54a1d5fda --- /dev/null +++ b/qwq-32b-q2_k-00002-of-00004.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a15a107a6dcf209320ff0872cf1ee411e7a913fc2525882215e6f316d08c1633 +size 3987016768 diff --git a/qwq-32b-q2_k-00003-of-00004.gguf b/qwq-32b-q2_k-00003-of-00004.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b07ea829955c2330bb5668507997f4d715986560 --- /dev/null +++ b/qwq-32b-q2_k-00003-of-00004.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:25f537daadb79c7f5e0e8611129aa3c446f75ffd1d742e3f9f78c8372562a950 +size 3398403296 diff --git a/qwq-32b-q2_k-00004-of-00004.gguf b/qwq-32b-q2_k-00004-of-00004.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d6b4c64dc214973100a7adbe887041fb96da5e3d --- /dev/null +++ b/qwq-32b-q2_k-00004-of-00004.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d152c3c66ca6f49b3752f1538a49b7b3cd72fbaf0026541564c9aa0b19252c63 +size 924333184 diff --git a/qwq-32b-q3_k_m-00001-of-00005.gguf b/qwq-32b-q3_k_m-00001-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ae3526d4deb5643d63b82be4a3a5180607579407 --- /dev/null +++ b/qwq-32b-q3_k_m-00001-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b80074415f1dcf503acdebbcbb72edc665a54fafaea1014e2913c0bc6053edd +size 3980600576 diff --git a/qwq-32b-q3_k_m-00002-of-00005.gguf b/qwq-32b-q3_k_m-00002-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..47d4325faa2b9613d69001037a938a68e81e9686 --- /dev/null +++ b/qwq-32b-q3_k_m-00002-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aae8130436aae6a8068bfefad2fa468de7fe0034e906a4ad60c45f4dc038fbce +size 3953507872 diff --git a/qwq-32b-q3_k_m-00003-of-00005.gguf b/qwq-32b-q3_k_m-00003-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..08ed9282e9f4681a0952d60dde1af51cd7d24fab --- /dev/null +++ b/qwq-32b-q3_k_m-00003-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:882610d21e3def857c094429bcff930068e14c63e1565ee6b919b1b082d308fe +size 3953507872 diff --git a/qwq-32b-q3_k_m-00004-of-00005.gguf b/qwq-32b-q3_k_m-00004-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..d897cf2c5fc5a58949333684d75fc7ae79ef9aec --- /dev/null +++ b/qwq-32b-q3_k_m-00004-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2dcc142e7c92c26650518507c4c30c91e897072cc03787b365018262328a88e4 +size 3955324544 diff --git a/qwq-32b-q3_k_m-00005-of-00005.gguf b/qwq-32b-q3_k_m-00005-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..822d9bd9f610dca3ef287ba34cadbaac1bc018d6 --- /dev/null +++ b/qwq-32b-q3_k_m-00005-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e95cd13ffdd23402610686d29a1967beee416f4f8b9d27b67d3cda7fe018682c +size 92107424 diff --git a/qwq-32b-q4_0-00001-of-00005.gguf b/qwq-32b-q4_0-00001-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..76b6ddee3944fdeaed5fcab937e1f8e9e75e7308 --- /dev/null +++ b/qwq-32b-q4_0-00001-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca37c5214988c8a3303a09ec9c50098197feab739e750b89270831edbe9996bb +size 3992579712 diff --git a/qwq-32b-q4_0-00002-of-00005.gguf b/qwq-32b-q4_0-00002-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..11a819d563dfaa80be6597a4a5fbc446965b77d5 --- /dev/null +++ b/qwq-32b-q4_0-00002-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:491179d1134bf258637a0e3aa60fde9be84862de098c01abdaf760098ab09b89 +size 3938084672 diff --git a/qwq-32b-q4_0-00003-of-00005.gguf b/qwq-32b-q4_0-00003-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4b2f614b91551b2612058cf4711e213526ac8b98 --- /dev/null +++ b/qwq-32b-q4_0-00003-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:941ce2ddfe466cf5a4d32bc42f9968d9a83599312afa3c9736ffda5b8aaf75d6 +size 3999991456 diff --git a/qwq-32b-q4_0-00004-of-00005.gguf b/qwq-32b-q4_0-00004-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4a6f9846ef3bb16ab0ec34ac5e722b23a4b55b11 --- /dev/null +++ b/qwq-32b-q4_0-00004-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3326a7a693fb126114da8d424a6ee17a6086482d885a87d00adec214ebce7354 +size 3955824704 diff --git a/qwq-32b-q4_0-00005-of-00005.gguf b/qwq-32b-q4_0-00005-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..77eb18abcf905f43bc5789417cd78a19036431fc --- /dev/null +++ b/qwq-32b-q4_0-00005-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:22336b83030d28f5db53bcf1c3a3f94c5b66071d2abd167b52b977dcf57a8197 +size 2753750496 diff --git a/qwq-32b-q4_k_m-00001-of-00005.gguf b/qwq-32b-q4_k_m-00001-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..54834d26bb294feba1c772e1e6a8ee9c1f07d564 --- /dev/null +++ b/qwq-32b-q4_k_m-00001-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e5bf16723d3f41207e946d2d4bfcd1de411e0aaa552c5d81dcbc9926f9d55f1 +size 3961498240 diff --git a/qwq-32b-q4_k_m-00002-of-00005.gguf b/qwq-32b-q4_k_m-00002-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a8dd43a65e290b1e138bd2ae7d905c6b4fac103f --- /dev/null +++ b/qwq-32b-q4_k_m-00002-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2edfaf4ee30a298db86bf339dce03b013006d87b43a579fa9d80904022b62c2f +size 3948996064 diff --git a/qwq-32b-q4_k_m-00003-of-00005.gguf b/qwq-32b-q4_k_m-00003-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0a70c3adfbe937772f2fd52916f91d8a507a7881 --- /dev/null +++ b/qwq-32b-q4_k_m-00003-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:063a3cc4e92000b66ea446b53974793f3912a85d0dab9a247b972fd5157a8258 +size 3993478688 diff --git a/qwq-32b-q4_k_m-00004-of-00005.gguf b/qwq-32b-q4_k_m-00004-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b8eb2ac193fd16c701fbb875d2e797705e4f7673 --- /dev/null +++ b/qwq-32b-q4_k_m-00004-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6c86d5aac0178454c9fbe1c89badd902231dbb45997e657aeb6a482255bbd71 +size 3950347744 diff --git a/qwq-32b-q4_k_m-00005-of-00005.gguf b/qwq-32b-q4_k_m-00005-of-00005.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b871500304f50b7c6ba1a8f85352f3bc9a87018c --- /dev/null +++ b/qwq-32b-q4_k_m-00005-of-00005.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1fd1631e20933c7abda9cee3eeedacbd18b60cf7cfede0d621440c902f686edd +size 3997015616 diff --git a/qwq-32b-q5_0-00001-of-00006.gguf b/qwq-32b-q5_0-00001-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ad3a7642893281d90875ef4bb4a9d5debb2ccda2 --- /dev/null +++ b/qwq-32b-q5_0-00001-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43741433b76bb32a49464ddae4a2249bc72e077c3a4d187faf6834790ef67c48 +size 3994998720 diff --git a/qwq-32b-q5_0-00002-of-00006.gguf b/qwq-32b-q5_0-00002-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..67e3fbe767ae1e1ad2ffb7166e791ed7b61e98fc --- /dev/null +++ b/qwq-32b-q5_0-00002-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24a1586c2b860e5260a83b3cdd625aaaad85b14fc0f2ff7a18fbc59163fff217 +size 3922513920 diff --git a/qwq-32b-q5_0-00003-of-00006.gguf b/qwq-32b-q5_0-00003-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3d8522e5b1a9594acc595542159ffc9fe3b36e30 --- /dev/null +++ b/qwq-32b-q5_0-00003-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c8b977be4143212eb4a75d3b46048eed79032aed675ebe842795eb6cf2f8298 +size 3983769504 diff --git a/qwq-32b-q5_0-00004-of-00006.gguf b/qwq-32b-q5_0-00004-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..62c25e6dfca54dad9022e47cb1e388b31bdb50a3 --- /dev/null +++ b/qwq-32b-q5_0-00004-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f4e6d3726fc2f6e5243aedae31a466f5baa4efeccf5e216500efff7cc176d0b5 +size 3922493408 diff --git a/qwq-32b-q5_0-00005-of-00006.gguf b/qwq-32b-q5_0-00005-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..768ba0f160a23e27edb1312925d6b30535a02263 --- /dev/null +++ b/qwq-32b-q5_0-00005-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:072edd7dbf8178fec8e9c06d678f03f787a3f83eedafbe68b7bfcb551a9cafd2 +size 3926122624 diff --git a/qwq-32b-q5_0-00006-of-00006.gguf b/qwq-32b-q5_0-00006-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..52d893152d55d44ca8437b5ed8d3a687c719ed06 --- /dev/null +++ b/qwq-32b-q5_0-00006-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fc6a11915091af03f5eda38c582ca4224147736c80165d1931a8256a4bf28cc +size 2888356672 diff --git a/qwq-32b-q5_k_m-00001-of-00006.gguf b/qwq-32b-q5_k_m-00001-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..a6f669bfe1fe027a9fc85747213fb2cb145177da --- /dev/null +++ b/qwq-32b-q5_k_m-00001-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77c6f293ec0ddbcf251f207ba5d1b7c74271eebc45e039ca4a06c48f50597137 +size 3952703136 diff --git a/qwq-32b-q5_k_m-00002-of-00006.gguf b/qwq-32b-q5_k_m-00002-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3cfa2c22adb6946d8d8f9dcbda7c303fe7bd7e89 --- /dev/null +++ b/qwq-32b-q5_k_m-00002-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8425171978a38cb198fa382ce4248cd3a892f168d8d22c88e3bdd1b8b8e26d53 +size 3960827616 diff --git a/qwq-32b-q5_k_m-00003-of-00006.gguf b/qwq-32b-q5_k_m-00003-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..838eeaee01c1922174961b7b4f0fad860e233037 --- /dev/null +++ b/qwq-32b-q5_k_m-00003-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a229150c632e5a90d5e5469866eb4e464382b845ea63001f328de9d58592a46b +size 3982458784 diff --git a/qwq-32b-q5_k_m-00004-of-00006.gguf b/qwq-32b-q5_k_m-00004-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0da0b7d8bf8d20b05f4b7fc8e0a08ab8357cbb72 --- /dev/null +++ b/qwq-32b-q5_k_m-00004-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4cab37257d0d9c475c7ae1f47ac68c183d0acb69c26c8241896c2fe392e32718 +size 3982438240 diff --git a/qwq-32b-q5_k_m-00005-of-00006.gguf b/qwq-32b-q5_k_m-00005-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..dee1fb00d239dc46ce12a5a68ce2a9c23e2cb807 --- /dev/null +++ b/qwq-32b-q5_k_m-00005-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b6d82fb5748c57877f3fdbc71f07149f09bff8bf16faa7f019970060f74bf93c +size 3906789440 diff --git a/qwq-32b-q5_k_m-00006-of-00006.gguf b/qwq-32b-q5_k_m-00006-of-00006.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b0ba80d7229b428eb9c3ca51074312bc62874eca --- /dev/null +++ b/qwq-32b-q5_k_m-00006-of-00006.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:629fbd313912898eeb9c143e150d314d691bcac599ad95ee4acab4dc79bc64b1 +size 3476940320 diff --git a/qwq-32b-q6_k-00001-of-00007.gguf b/qwq-32b-q6_k-00001-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4924196a374cc1216756c5ea1ccc218a64d4b7e8 --- /dev/null +++ b/qwq-32b-q6_k-00001-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bcbfe051eda17638209f88d0bc0761d456e49fb9802938fdc18cf01f6921128f +size 3986911968 diff --git a/qwq-32b-q6_k-00002-of-00007.gguf b/qwq-32b-q6_k-00002-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..e1e2f8580cbc2ec16f022228e10cafdd8b2c1a5b --- /dev/null +++ b/qwq-32b-q6_k-00002-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:937a683fbf75500abade8f1f3fa4784a72bf52457b100e9ba83d28491c72bede +size 3978922688 diff --git a/qwq-32b-q6_k-00003-of-00007.gguf b/qwq-32b-q6_k-00003-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..98e2463e5d527953d973cce827e2c125a97d0572 --- /dev/null +++ b/qwq-32b-q6_k-00003-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:74480f6dcc002fc5ca5c2b99a7152a44f8efd4d6fe4ea57572ecec44d41423d3 +size 3996162848 diff --git a/qwq-32b-q6_k-00004-of-00007.gguf b/qwq-32b-q6_k-00004-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..0983bbbdaa8ea4af0056b81257837e0442d62c82 --- /dev/null +++ b/qwq-32b-q6_k-00004-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b7be99f67f624db075bfac5592f6e8d49b4bd3067b4712468b4088ac4b51dd2 +size 3884305120 diff --git a/qwq-32b-q6_k-00005-of-00007.gguf b/qwq-32b-q6_k-00005-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..2d342037f132b1355c24261ecfaf624b10ce52db --- /dev/null +++ b/qwq-32b-q6_k-00005-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af6278710ce008a645be4c3ea52d9e6f107beccbf8e42dadd0bd5332e7f04a5a +size 3996146464 diff --git a/qwq-32b-q6_k-00006-of-00007.gguf b/qwq-32b-q6_k-00006-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..3367c69a67bc7d0622d71b3c8ddcbd85e68650a2 --- /dev/null +++ b/qwq-32b-q6_k-00006-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e69dcc2a9181f16e75330cce3662aaf526a21ebc86a119e276fb5b71418a3478 +size 3978939104 diff --git a/qwq-32b-q6_k-00007-of-00007.gguf b/qwq-32b-q6_k-00007-of-00007.gguf new file mode 100644 index 0000000000000000000000000000000000000000..73a8984c9d0fe570eb1f168ccf2863a6bccf6e2b --- /dev/null +++ b/qwq-32b-q6_k-00007-of-00007.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6de91749315bd33d92ed11aa861c05a42a9de0b21dfb080a10d0df48e1a24c0 +size 3064766880 diff --git a/qwq-32b-q8_0-00001-of-00009.gguf b/qwq-32b-q8_0-00001-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..750d4105e6aeb3d79756e9e848c1c3b80f5597b3 --- /dev/null +++ b/qwq-32b-q8_0-00001-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:83d1d6c8a84a0109e7149fb908a965f7e0b90672f4c6f2bf66c783a9a0744568 +size 3941956736 diff --git a/qwq-32b-q8_0-00002-of-00009.gguf b/qwq-32b-q8_0-00002-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..88af4c91d7bf8279f97335d45268ada897059fba --- /dev/null +++ b/qwq-32b-q8_0-00002-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:568bb962b4b9d250d6bd26f1cc01a1b2360366a5740082c221dab402def5d4ce +size 3927757760 diff --git a/qwq-32b-q8_0-00003-of-00009.gguf b/qwq-32b-q8_0-00003-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..fda63351f2d4038a216024c486db30e1896567d6 --- /dev/null +++ b/qwq-32b-q8_0-00003-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fef8bde2ef647883e95b62ebbed1d90cffef1dc14378519238fc671a97b74f4 +size 3994654144 diff --git a/qwq-32b-q8_0-00004-of-00009.gguf b/qwq-32b-q8_0-00004-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..fefc60dc821f4d1ff5e4028b2f6feea60a826821 --- /dev/null +++ b/qwq-32b-q8_0-00004-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c1547e5061afa97284baae191be7868b8f26d5ce00d3cb9d9d51653d4eec156d +size 3994654144 diff --git a/qwq-32b-q8_0-00005-of-00009.gguf b/qwq-32b-q8_0-00005-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..8883282879e359ef9984cd4fc43b3e383019749d --- /dev/null +++ b/qwq-32b-q8_0-00005-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4115b67295c2fbc2140298665b6b7c865bf2316a3085164a2f89b215ff2db667 +size 3927737280 diff --git a/qwq-32b-q8_0-00006-of-00009.gguf b/qwq-32b-q8_0-00006-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..ebe2447c47a472f7ad1853ab3482969ac7ee629c --- /dev/null +++ b/qwq-32b-q8_0-00006-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc7c0864650794dab8664b172402e9e683c2ef5d7d24c53592fe98928ff7e761 +size 3994654144 diff --git a/qwq-32b-q8_0-00007-of-00009.gguf b/qwq-32b-q8_0-00007-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..4fef4c8c529aa203d5003d170db31b5d987dfdd2 --- /dev/null +++ b/qwq-32b-q8_0-00007-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8079aff1b426e7ba7d29cb037c5e5d3e217dc798369d464c1c6ba114659ccb6a +size 3994654144 diff --git a/qwq-32b-q8_0-00008-of-00009.gguf b/qwq-32b-q8_0-00008-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..96a1be2f2c9df2bba5b6bdce3a68058c15ac1974 --- /dev/null +++ b/qwq-32b-q8_0-00008-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07fd26da079f7dc1fcce594bf41fc7ce3864036fcd4582f2525adb3d2366b64d +size 3927737280 diff --git a/qwq-32b-q8_0-00009-of-00009.gguf b/qwq-32b-q8_0-00009-of-00009.gguf new file mode 100644 index 0000000000000000000000000000000000000000..b4330eabaf9e937991ff2bfb096d1e5c31547889 --- /dev/null +++ b/qwq-32b-q8_0-00009-of-00009.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cef1609691f1674efc37b3170c1a0c5a251fe20a16b061c2561b6389a53bd5e9 +size 3117079968