q4f16_1 converted model(4bit Quantized) from Llama-2-ko-7b-Chat

This repository includes 4bit quantized model with MLC-LLM, with the weights from kfkas/Llama-2-ko-7b-Chat.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

beomi
/

Llama-2-ko-7b-Chat-q4f16_1

q4f16_1 converted model(4bit Quantized) from Llama-2-ko-7b-Chat

Dataset used to train beomi/Llama-2-ko-7b-Chat-q4f16_1