Model

This model has been fine-tuned based on Meta-Llama/Meta-Llama-3-8B-Instruct using the mlx-lm with a cleaned-up function calling dataset that removed invalid JSON data and single quotes around argument values. It is a GGUF Q4_0 for the model originally found at https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2

Usage

Just load the GGUF

Downloads last month
4
GGUF
Model size
8.03B params
Architecture
llama

4-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Dataset used to train ghhwer/mzbac-llama-3-8B-Instruct-function-calling-v0.2-GGUF