karakuri-lm-chat-upscaled-103b-v0.1-GGUF

概要

Aratako/karakuri-lm-chat-upscaled-103b-v0.1の量子化済みGGUF版です。ライセンス等詳細は元モデルをご確認ください。

現在はQ4_K_Mのみです。需要ありそうであれば他のものも用意します。

Description

This is the quantized GGUF version of Aratako/karakuri-lm-chat-upscaled-103b-v0.1. Please refer to the original model for license details and more information.

Currently, only Q4_K_M is available. If there is demand, other versions may be provided as well.

使い方/How to use

cat karakuri-lm-chat-upscaled-103b-v0.1-Q4_K_M.gguf.* > karakuri-lm-chat-upscaled-103b-v0.1-Q4_K_M.gguf
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Aratako/karakuri-lm-chat-upscaled-103b-v0.1-GGUF