gwonny commited on
Commit
039a445
·
verified ·
1 Parent(s): 901ba26

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -9,7 +9,8 @@ language:
9
  We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3
10
 
11
  ## Model Description
12
- We use QLoRA and NEFTune on LLM Fine-tuning
 
13
 
14
  ## Train Detail
15
  Our Korean Wiki QA data used, and 3 epoch train
 
9
  We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3
10
 
11
  ## Model Description
12
+ We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning
13
+ lr = 2e-4
14
 
15
  ## Train Detail
16
  Our Korean Wiki QA data used, and 3 epoch train