mergekit-dare_ties-wqlkund / mergekit_config.yml
mergekit-uploader's picture
Upload folder using huggingface_hub
3390252 verified
raw
history blame contribute delete
501 Bytes
models:
- model: alpindale/Llama-3.2-3B
parameters:
weight: 0.3
- model: unsloth/Llama-3.2-3B-Instruct
parameters:
density: 0.3
weight: 0.25
- model: belyakoff/llama-3.2-3b-instruct-fine-tuned
parameters:
density: 0.3
weight: 0.25
- model: Medragondot/llama-3.2-3b-thinking
parameters:
density: 0.15
weight: 0.2
merge_method: dare_ties
base_model: alpindale/Llama-3.2-3B
parameters:
normalize: true
int8_mask: true
dtype: bfloat16