What is this?
A nice, simple Slerp merge of 2 Mistral "Small" model and well-known HuggingFace users, TheDrummer/Cydonia-24B-v2 & PocketDoc/Dans-PersonalityEngine-V1.2.0-24b.
This version is the best merge version and recipe I have tried with a good eval scores. Strong in ERP, RP, Story Writing and orther purpose.
Overall, nice to try model, if you want to try. :)
Other information
Chat Template? ChatML, of course!
Merge Method
Detail YAML Config
{
models:
- model: TheDrummer/Cydonia-24B-v2
- model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
merge_method: slerp
base_model: TheDrummer/Cydonia-24B-v2
parameters:
t: [0.1, 0.3, 0.6, 0.3, 0.1]
dtype: bfloat16
}
Detail YAML Config
{
models:
- model: TheDrummer/Cydonia-24B-v2
- model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
merge_method: slerp
base_model: TheDrummer/Cydonia-24B-v2
parameters:
t: [0.1, 0.3, 0.6, 0.3, 0.1]
dtype: bfloat16
}