KoboldAI

community

AI & ML interests

Fiction Models made by the KoboldAI community. All uploaded models are either uploaded by their original finetune authors or with the finetune authors permission. Visit our Discord at https://koboldai.org/discord

Recent Activity

Henk717 updated a model about 1 month ago

KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo

concedo updated a model about 2 months ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Henk717 updated a Space about 2 months ago

KoboldAI/Koboldcpp-Tiefighter

View all activity

KoboldAI's activity

Henk717

updated a model about 1 month ago

KoboldAI/LLaMA-3.1-8B-Infinity3M-Kobo

Updated Feb 7 • 61

concedo

updated a model about 2 months ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Updated Jan 27 • 60.3k • 93

Henk717

updated a Space about 2 months ago

Koboldcpp Tiefighter

🦎

concedo

updated a Space about 2 months ago

Koboldcpp Tiefighter

🦎

Henk717

updated 2 models 2 months ago

KoboldAI/Llama-3.1-8B-BookAdventures-GGUF

Updated Jan 4 • 1.09k • 2

KoboldAI/Llama-3.1-8B-BookAdventures

Updated Jan 4 • 73 • 6

elinas

posted an update 6 months ago

Post

2408

We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!

ZeusLabs/Chronos-Divergence-33B