File size: 1,144 Bytes
e53a46a d2afab4 e53a46a 11b4808 e53a46a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
---
license: llama3.1
datasets:
- Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
tags:
- conversational
- llama3
- llama
---
### Kumiho-V1-rp-UwU
Meet Kumiho-V1 uwu. More detailed REAMDE (In Progress)
Kumiho-V1-rp-UwU aims to be a generalist model with specialization in roleplay and writing capabilities. It is finetuned and merged with various models, with a heavy base of Meta's LLaMA 3.1-8B as base model, and Claude 3.5 Sonnet and Claude 3 Opus generated synthetic data.
**Data Mix:**
- Subset of 18k Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
- Secret sauce: Claude Sonnet 3.5 logic dataset with internal knowledge map roleplay prompting (may open source this) -> I believe this greatly enhanced "awareness."
**Models:**
- NousResearch/Meta-Llama-3.1-8B
- Sao10K/L3-8B-Stheno-v3.2
- Hastagaras/Jamet-8B-L3-MK.V-Blackroot
**Secret Sauce Models:**
- I achieved better experiences by finetuning on one dataset with specific parameters and then experimenting with different merges using Mergekit finding a good recipe for each merge. |