cdx1
Collection
Upcoming ML models from the CycloneDX Generator (cdxgen) team for xBOM analysis, validation, and reasoning.
•
9 items
•
Updated
PREVIEW RELEASE
Use LM Studio to download and test this model. Search for CycloneDX/cdx1-mlx-4bit
.
Use the below configurations:
System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
Temperature: 0.05
Max tokens: 8192 or 16000
Context length: 16000
Install miniconda or Python 3.11
conda create --name cdx1-mlx python=3.11
conda activate cdx1-mlx
pip install mlx
LLM Inference from the CLI.
mlx_lm.generate --model CycloneDX/cdx1-mlx-4bit --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05