Transformers
GGUF
Korean
mistral
trl
unsloth
Inference Endpoints
conversational
Dongwookss commited on
Commit
727d038
ยท
verified ยท
1 Parent(s): 115f31b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -3
README.md CHANGED
@@ -14,6 +14,15 @@ tags:
14
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66305fd7fdd79b4fe6d6a5e5/7UDKdaPfBJnazuIi1cUVw.png)
15
 
16
 
17
- - ** Base Model : ** 'HuggingFaceH4/zephyr-7b-beta'
18
- - ** Purpose : ** '์–ผ๋งˆ๋“ ์ง€ ๋ฌผ์–ด๋ณด์„ธ์š”~! ํ’‹ํ’‹!'์ด ๋ง ๋์— ๋ถ™์œผ๋ฉฐ 'ํ•ด์š”'์ฒด๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์ฑ—๋ด‡์„ ๊ตฌํ˜„ํ•˜๋ ค๊ณ  ํ•œ๋‹ค. ํ”„๋กœ์ ํŠธ ๋ชฉ์ ์ƒ RAG๋ฅผ ํ†ตํ•ด ํ’‹์‚ด ๋„๋ฉ”์ธ์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•˜๋Š” 'ํ’‹ํ’‹์ด' ์ปจ์…‰์ด๊ธฐ์— ๋งํˆฌ ์„ค์ •์ด ์ด์™€ ๊ฐ™๋‹ค.
19
- - ** Method : ** Unsloth ํŒจํ‚ค์ง€๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ vram์ด ์ดˆ๊ณผ๋˜์ง€ ์•Š๋„๋ก ํ•˜์˜€์œผ๋ฉฐ SFTrainer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋ชจ๋ธํ›ˆ๋ จ์„ ์ง„ํ–‰ํ•จ.
 
 
 
 
 
 
 
 
 
 
14
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/66305fd7fdd79b4fe6d6a5e5/7UDKdaPfBJnazuIi1cUVw.png)
15
 
16
 
17
+ - **Base Model :** 'HuggingFaceH4/zephyr-7b-beta'
18
+
19
+
20
+ - **Purpose :** '์–ผ๋งˆ๋“ ์ง€ ๋ฌผ์–ด๋ณด์„ธ์š”~! ํ’‹ํ’‹!'์ด ๋ง ๋์— ๋ถ™์œผ๋ฉฐ 'ํ•ด์š”'์ฒด๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ์ฑ—๋ด‡์„ ๊ตฌํ˜„ํ•˜๋ ค๊ณ  ํ•œ๋‹ค. ํ”„๋กœ์ ํŠธ ๋ชฉ์ ์ƒ RAG๋ฅผ ํ†ตํ•ด ํ’‹์‚ด ๋„๋ฉ”์ธ์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•˜๋Š” 'ํ’‹ํ’‹์ด' ์ปจ์…‰์ด๊ธฐ์— ๋งํˆฌ ์„ค์ •์ด ์ด์™€ ๊ฐ™๋‹ค.
21
+
22
+
23
+ - **Method :** Unsloth ํŒจํ‚ค์ง€๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ gpu ์ž์›์ด ์ดˆ๊ณผ๋˜์ง€ ์•Š๋„๋ก ํ•˜์˜€์œผ๋ฉฐ SFTrainer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋ชจ๋ธํ›ˆ๋ จ์„ ์ง„ํ–‰ํ•จ.
24
+
25
+
26
+ - **Environ :** Colab L4 GPU๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ง„ํ–‰ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
27
+
28
+ - **About gguf :** ํ’‹ํ’‹์ด ์ตœ์ข… ๋ฒ„์ „์„ ๋งŒ๋“ค๊ธฐ ์œ„ํ•ด ๊ฐ ๋‹จ๊ณ„๋ณ„ ๋ชจ๋ธ์„ ์ €์žฅํ•˜์˜€์Šต๋‹ˆ๋‹ค. ๋ชจ๋ธ **์–‘์žํ™”(Quantize)** ์ข…๋ฅ˜๋กœ F16, Q8_0, Q5_K_M 3๊ฐ€์ง€๋กœ ์ €์žฅํ•˜์˜€์Šต๋‹ˆ๋‹ค.