mlx-community/starcoder2-15b-instruct-v0.1-4bit
This model was converted to MLX format from bigcode/starcoder2-15b-instruct-v0.1 using mlx-lm version 0.10.0.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/starcoder2-15b-instruct-v0.1-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
- Downloads last month
- 8
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for mlx-community/starcoder2-15b-instruct-v0.1-4bit
Base model
bigcode/starcoder2-15bDataset used to train mlx-community/starcoder2-15b-instruct-v0.1-4bit
Evaluation results
- pass@1 on LiveCodeBench (code generation)self-reported20.400
- pass@1 on LiveCodeBench (self repair)self-reported20.900
- pass@1 on LiveCodeBench (test output prediction)self-reported29.800
- pass@1 on LiveCodeBench (code execution)self-reported28.100
- pass@1 on HumanEvalself-reported72.600
- pass@1 on HumanEval+self-reported63.400
- pass@1 on MBPPself-reported75.200
- pass@1 on MBPP+self-reported61.200
- pass@1 on DS-1000self-reported40.600