karakuri-lm-chat-upscaled-103b-v0.1-GGUF
概要
Aratako/karakuri-lm-chat-upscaled-103b-v0.1の量子化済みGGUF版です。ライセンス等詳細は元モデルをご確認ください。
現在はQ4_K_Mのみです。需要ありそうであれば他のものも用意します。
Description
This is the quantized GGUF version of Aratako/karakuri-lm-chat-upscaled-103b-v0.1. Please refer to the original model for license details and more information.
Currently, only Q4_K_M is available. If there is demand, other versions may be provided as well.
使い方/How to use
cat karakuri-lm-chat-upscaled-103b-v0.1-Q4_K_M.gguf.* > karakuri-lm-chat-upscaled-103b-v0.1-Q4_K_M.gguf
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for Aratako/karakuri-lm-chat-upscaled-103b-v0.1-GGUF
Base model
meta-llama/Llama-2-70b-hf
Finetuned
karakuri-ai/karakuri-lm-70b-v0.1
Finetuned
karakuri-ai/karakuri-lm-70b-chat-v0.1