CarrotAI commited on
Commit
8020a08
ยท
verified ยท
1 Parent(s): 6c55003

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -13,7 +13,43 @@ pipeline_tag: text-generation
13
 
14
  ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/Cji1GoDqERF0zCR9gKJKV.webp)
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ## Score
 
17
  LogicKor
18
  | Category | Single turn | Multi turn |
19
  |---|---|---|
 
13
 
14
  ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/Cji1GoDqERF0zCR9gKJKV.webp)
15
 
16
+ ## Model Description
17
+
18
+ ### Model Details
19
+ - **Name**: Carrot Llama-3.2 Rabbit Ko 2412
20
+ - **Version**: 3B Instruct
21
+ - **Base Model**: CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct-2412
22
+ - **Languages**: Korean, English
23
+ - **Model Type**: Large Language Model (Instruction-tuned)
24
+
25
+ ### Training Process
26
+ ๋ณธ ๋ชจ๋ธ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ์ฃผ์š” ํ›ˆ๋ จ ๋‹จ๊ณ„๋ฅผ ๊ฑฐ์ณค์Šต๋‹ˆ๋‹ค:
27
+
28
+ 1. **SFT (Supervised Fine-Tuning)**
29
+ - ๊ณ ํ’ˆ์งˆ ํ•œ๊ตญ์–ด ๋ฐ ์˜์–ด ๋ฐ์ดํ„ฐ์…‹์„ ์‚ฌ์šฉํ•˜์—ฌ ๊ธฐ๋ณธ ๋ชจ๋ธ์„ ์„ธ๋ถ€ ์กฐ์ •
30
+
31
+ 2. **DPO (Direct Preference Optimization)**
32
+ - ์ธ๊ฐ„์˜ ์„ ํ˜ธ๋„๋ฅผ ์ง์ ‘์ ์œผ๋กœ ๋ฐ˜์˜ํ•˜์—ฌ ๋ชจ๋ธ์˜ ์‘๋‹ต ํ’ˆ์งˆ ๊ฐœ์„ 
33
+ - ๋ชจ๋ธ์˜ ์ผ๊ด€์„ฑ, ์ •ํ™•์„ฑ, ๊ทธ๋ฆฌ๊ณ  ์‚ฌ์šฉ์ž ์„ ํ˜ธ๋„๋ฅผ ์ตœ์ ํ™”
34
+
35
+ ### Limitations
36
+ - 3B ํŒŒ๋ผ๋ฏธํ„ฐ ๊ทœ๋ชจ๋กœ ์ธํ•œ ๋ณต์žกํ•œ ์ž‘์—…์—์„œ์˜ ์ œํ•œ์  ์„ฑ๋Šฅ
37
+ - ํŠน์ • ๋„๋ฉ”์ธ์— ๋Œ€ํ•œ ๊นŠ์ด ์žˆ๋Š” ์ „๋ฌธ์„ฑ ๋ถ€์กฑ
38
+ - ํŽธํ–ฅ์„ฑ ๋ฐ ํ™˜๊ฐ ๊ฐ€๋Šฅ์„ฑ
39
+
40
+ ### Ethics Statement
41
+ ๋ชจ๋ธ ๊ฐœ๋ฐœ ๊ณผ์ •์—์„œ ์œค๋ฆฌ์  ๊ณ ๋ ค์‚ฌํ•ญ์„ ์ตœ๋Œ€ํ•œ ๋ฐ˜์˜ํ•˜์˜€์œผ๋‚˜, ์‚ฌ์šฉ์ž๋Š” ํ•ญ์ƒ ๊ฒฐ๊ณผ๋ฅผ ๋น„ํŒ์ ์œผ๋กœ ๊ฒ€ํ† ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
42
+
43
+ ### How to Use
44
+ ```python
45
+ from transformers import AutoModelForCausalLM, AutoTokenizer
46
+
47
+ model = AutoModelForCausalLM.from_pretrained("CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct-2412")
48
+ tokenizer = AutoTokenizer.from_pretrained("CarrotAI/Llama-3.2-Rabbit-Ko-3B-Instruct-2412")
49
+ ```
50
+
51
  ## Score
52
+ ### Performance Metrics
53
  LogicKor
54
  | Category | Single turn | Multi turn |
55
  |---|---|---|