File size: 803 Bytes
16becac 290cccd 16becac 290cccd 16becac 0246ed5 16becac 290cccd |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
library_name: transformers
license: cc-by-nc-4.0
tags:
- creative-writing
- creative-writer
- multiplicative-lora
---
An experimental model, fine-tuned using the "multiplicative-LoRA" method on [c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01).
This model is nearly identical to [creative-writer-v0.1-alfa-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-alfa-35b) except the pre-softmax logits were scaled by `1.1` during training to increased single-token Entropy, and it was trained using the new `v0.2` dataset which is around 15% larger and also more carefully curated to remove any weird formatting.
Please refer to [creative-writer-v0.1-alfa-35b](https://huggingface.co/jukofyork/creative-writer-v0.1-alfa-35b) for full details on how to use this model. |