How to Train this model
#1
by
LuckyNik
- opened
Would it be possible to advice how to train this model further, is there a link that you could provide to show how to train the AI?
Thanks
Hello,
You will need to get or create a dataset. If you just have text, you can pre-train. I used Unsloth. See below,
https://docs.unsloth.ai/basics/continued-pretraining
https://unsloth.ai/blog/contpretraining
if you want to fien tune, you need the correct format dataset
https://docs.unsloth.ai/basics/tutorial-how-to-finetune-llama-3-and-use-in-ollama