KBNIT/Llama-3-8B-kolon-ITD-5-v1.0

Base Model:

We made a LLM model with meta-llama/Meta-Llama-3-8B

Model Description

We use QDoRA(256, 64) and lr=1e-5, NEFTune=3

Train Detail

Our changed private data used, and 5 epoch train

Others

We are making LLM model for Kolon !