Model Stock: All we need is just a few fine-tuned models
Paper
• 2403.19522 • Published
• 14
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using DreadPoor/Alita99-8B-LINEAR as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/sociology
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/psychology
- model: tannedbum/L3-Nymeria-v2-8B+kloodia/lora-8b-physic
- model: tannedbum/L3-Nymeria-v2-8B+kloodia/lora-8b-bio
- model: tannedbum/L3-Nymeria-v2-8B+ResplendentAI/Llama3_RP_ORPO_LoRA
- model: tannedbum/L3-Nymeria-v2-8B+vincentyandex/lora_llama3_chunked_novel_bs128
- model: tannedbum/L3-Nymeria-v2-8B+eeeebbb2/3aff0ea7-4262-4abb-97b1-1879f340d32e
- model: tannedbum/L3-Nymeria-v2-8B+Blackroot/Llama-3-LongStory-LORA
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/formal_logic
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/health
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/conceptual_physics
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/professional_psychology
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/professional_medicine
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/anatomy
- model: tannedbum/L3-Nymeria-v2-8B+surya-narayanan/human_sexuality
merge_method: model_stock
base_model: DreadPoor/Alita99-8B-LINEAR
dtype: bfloat16