PREVIEW RELEASE

Testing with LM Studio

Use LM Studio to download and test this model. Search for CycloneDX/cdx1-mlx-4bit.

Use the below configurations:

System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
Temperature: 0.05
Max tokens: 8192 or 16000
Context length: 16000

Testing with mlx

Install miniconda or Python 3.11

conda create --name cdx1-mlx python=3.11
conda activate cdx1-mlx
pip install mlx

LLM Inference from the CLI.

mlx_lm.generate --model CycloneDX/cdx1-mlx-4bit --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05
Downloads last month
0
Safetensors
Model size
2.29B params
Tensor type
BF16
·
U32
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for CycloneDX/cdx1-mlx-4bit

Base model

microsoft/phi-4
Finetuned
unsloth/phi-4
Quantized
(17)
this model

Dataset used to train CycloneDX/cdx1-mlx-4bit

Collection including CycloneDX/cdx1-mlx-4bit