Deepseek-Lumen-R1-Qwen2.5-14B / mergekit_config.yml
x0000001's picture
Upload folder using huggingface_hub
bfbefb9 verified
raw
history blame contribute delete
384 Bytes
models:
- model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2
parameters:
weight: 1.0
density: 0.9
- model: v000000/Qwen2.5-Lumen-14B
parameters:
weight: 0.25
density: 0.88
merge_method: della_linear
base_model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2
parameters:
int8_mask: true
epsilon: 0.07
lambda: 1
dtype: bfloat16