Here we have .gguf and .safetensors of mistralai/Mistral-Instruct-v0.1 for use with Huggingface/Candle.

You can try the models with Candle Chat, or make similar models with Candle Tensor Tools.

Refer to the main model card.

Downloads last month: 119

GGUF

Model size

7.24B params

Architecture

undefined

4-bit

5-bit

8-bit

16-bit

View +6 files

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for DanielClough/Candle_Mistral-7B-Instruct-v0.1

Quantizations

2 models