gwonny commited on
Commit
b4f8807
·
verified ·
1 Parent(s): 5983ce2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -9,7 +9,8 @@ language:
9
  We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3
10
 
11
  ## Model Description
12
- We use QLoRA and NEFTune on LLM Fine-tuning
 
13
 
14
  ## Train Detail
15
  Our Korean data used, and 1 epoch train
 
9
  We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3
10
 
11
  ## Model Description
12
+ We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning
13
+ lr=1e-5
14
 
15
  ## Train Detail
16
  Our Korean data used, and 1 epoch train