--- base_model: - nbeerbower/Llama-3.1-Nemotron-lorablated-70B - ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3 - TheDrummer/Fallen-Llama-3.3-R1-70B-v1 - EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1 - SicariusSicariiStuff/Negative_LLAMA_70B - LatitudeGames/Wayfarer-Large-70B-Llama-3.3 library_name: transformers tags: - mergekit - merge license: llama3.3 --- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64909c086073a0cd172d0411/KK8hCbd8KXy03cP_qzdij.png) V2 of Dungeonmaster, I decided to move away from the R1 base here, because I feel it the pros dont necessarily outweigh the cons. For V2 I decided to go for the classic nbeerbower/Llama-3.1-Nemotron-lorablated-70B as the base. Dungeonmaster is meant to be specifically for creative roleplays with stakes and consequences using the following curated models: - LatitudeGames/Wayfarer-Large-70B-Llama-3.3 - A fine-tuned model specifically designed for this very application. - ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3 - Another fine-tuned trained on RP datasets. - EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1 - For it's strong descriptive writing. - SicariusSicariiStuff/Negative_LLAMA_70B - To assist with the darker undertones. - TheDrummer/Fallen-Llama-3.3-R1-70B-v1 - The secret sauce, a completely unhinged thinking model that turns things up to 11. # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Linear DELLA](https://arxiv.org/abs/2406.11617) merge method using [nbeerbower/Llama-3.1-Nemotron-lorablated-70B](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B) as a base. ### Models Merged The following models were included in the merge: * [ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3](https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3) * [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1) * [EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1](https://huggingface.co/EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1) * [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B) * [LatitudeGames/Wayfarer-Large-70B-Llama-3.3](https://huggingface.co/LatitudeGames/Wayfarer-Large-70B-Llama-3.3) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: LatitudeGames/Wayfarer-Large-70B-Llama-3.3 parameters: weight: 0.20 density: 0.7 - model: ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3 parameters: weight: 0.20 density: 0.7 - model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1 parameters: weight: 0.20 density: 0.7 - model: SicariusSicariiStuff/Negative_LLAMA_70B parameters: weight: 0.20 density: 0.7 - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1 parameters: weight: 0.20 density: 0.7 merge_method: della_linear base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B parameters: epsilon: 0.2 lambda: 1.1 dtype: bfloat16 tokenizer: source: nbeerbower/Llama-3.1-Nemotron-lorablated-70B ```