RichardErkhov commited on
Commit
a1b0f13
·
verified ·
1 Parent(s): b91aa9b

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +199 -0
README.md ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ Apollo-6B - GGUF
11
+ - Model creator: https://huggingface.co/FreedomIntelligence/
12
+ - Original model: https://huggingface.co/FreedomIntelligence/Apollo-6B/
13
+
14
+
15
+ | Name | Quant method | Size |
16
+ | ---- | ---- | ---- |
17
+ | [Apollo-6B.Q2_K.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q2_K.gguf) | Q2_K | 2.18GB |
18
+ | [Apollo-6B.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.IQ3_XS.gguf) | IQ3_XS | 2.41GB |
19
+ | [Apollo-6B.IQ3_S.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.IQ3_S.gguf) | IQ3_S | 2.53GB |
20
+ | [Apollo-6B.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q3_K_S.gguf) | Q3_K_S | 2.52GB |
21
+ | [Apollo-6B.IQ3_M.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.IQ3_M.gguf) | IQ3_M | 2.62GB |
22
+ | [Apollo-6B.Q3_K.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q3_K.gguf) | Q3_K | 2.79GB |
23
+ | [Apollo-6B.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q3_K_M.gguf) | Q3_K_M | 2.79GB |
24
+ | [Apollo-6B.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q3_K_L.gguf) | Q3_K_L | 3.01GB |
25
+ | [Apollo-6B.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.IQ4_XS.gguf) | IQ4_XS | 3.11GB |
26
+ | [Apollo-6B.Q4_0.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q4_0.gguf) | Q4_0 | 3.24GB |
27
+ | [Apollo-6B.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.IQ4_NL.gguf) | IQ4_NL | 3.27GB |
28
+ | [Apollo-6B.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q4_K_S.gguf) | Q4_K_S | 3.26GB |
29
+ | [Apollo-6B.Q4_K.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q4_K.gguf) | Q4_K | 3.42GB |
30
+ | [Apollo-6B.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q4_K_M.gguf) | Q4_K_M | 3.42GB |
31
+ | [Apollo-6B.Q4_1.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q4_1.gguf) | Q4_1 | 3.58GB |
32
+ | [Apollo-6B.Q5_0.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q5_0.gguf) | Q5_0 | 3.92GB |
33
+ | [Apollo-6B.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q5_K_S.gguf) | Q5_K_S | 3.92GB |
34
+ | [Apollo-6B.Q5_K.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q5_K.gguf) | Q5_K | 4.01GB |
35
+ | [Apollo-6B.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q5_K_M.gguf) | Q5_K_M | 4.01GB |
36
+ | [Apollo-6B.Q5_1.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q5_1.gguf) | Q5_1 | 4.25GB |
37
+ | [Apollo-6B.Q6_K.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q6_K.gguf) | Q6_K | 4.63GB |
38
+ | [Apollo-6B.Q8_0.gguf](https://huggingface.co/RichardErkhov/FreedomIntelligence_-_Apollo-6B-gguf/blob/main/Apollo-6B.Q8_0.gguf) | Q8_0 | 6.0GB |
39
+
40
+
41
+
42
+
43
+ Original model description:
44
+ ---
45
+ license: apache-2.0
46
+ ---
47
+ # Multilingual Medicine: Model, Dataset, Benchmark, Code
48
+
49
+ Covering English, Chinese, French, Hindi, Spanish, Hindi, Arabic So far
50
+
51
+
52
+ <p align="center">
53
+ 👨🏻‍💻<a href="https://github.com/FreedomIntelligence/Apollo" target="_blank">Github</a> •📃 <a href="https://arxiv.org/abs/2403.03640" target="_blank">Paper</a> • 🌐 <a href="https://apollo.llmzoo.com/" target="_blank">Demo</a> • 🤗 <a href="https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus" target="_blank">ApolloCorpus</a> • 🤗 <a href="https://huggingface.co/datasets/FreedomIntelligence/XMedbench" target="_blank">XMedBench</a>
54
+ <br> <a href="./README_zh.md"> 中文 </a> | <a href="./README.md"> English
55
+ </p>
56
+
57
+ ![Apollo](assets/apollo_medium_final.png)
58
+
59
+ ## 🌈 Update
60
+
61
+ * **[2024.03.07]** [Paper](https://arxiv.org/abs/2403.03640) released.
62
+ * **[2024.02.12]** <a href="https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus" target="_blank">ApolloCorpus</a> and <a href="https://huggingface.co/datasets/FreedomIntelligence/XMedbench" target="_blank">XMedBench</a> is published!🎉
63
+ * **[2024.01.23]** Apollo repo is published!🎉
64
+
65
+
66
+ ## Results
67
+ 🤗<a href="https://huggingface.co/FreedomIntelligence/Apollo-0.5B" target="_blank">Apollo-0.5B</a> • ��� <a href="https://huggingface.co/FreedomIntelligence/Apollo-1.8B" target="_blank">Apollo-1.8B</a> • 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-2B" target="_blank">Apollo-2B</a> • 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-6B" target="_blank">Apollo-6B</a> • 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-7B" target="_blank">Apollo-7B</a>
68
+
69
+ 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-0.5B-GGUF" target="_blank">Apollo-0.5B-GGUF</a> • 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-2B-GGUF" target="_blank">Apollo-2B-GGUF</a> • 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-6B-GGUF" target="_blank">Apollo-6B-GGUF</a> • 🤗 <a href="https://huggingface.co/FreedomIntelligence/Apollo-7B-GGUF" target="_blank">Apollo-7B-GGUF</a>
70
+
71
+
72
+ ![Apollo](assets/result.png)
73
+
74
+
75
+
76
+ ## Usage Format
77
+
78
+ User:{query}\nAssistant:{response}<|endoftext|>
79
+
80
+
81
+ ## Dataset & Evaluation
82
+
83
+ - Dataset
84
+ 🤗 <a href="https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus" target="_blank">ApolloCorpus</a>
85
+
86
+ <details><summary>Click to expand</summary>
87
+
88
+ ![Apollo](assets/dataset.png)
89
+
90
+ - [Zip File](https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus/blob/main/ApolloCorpus.zip)
91
+ - [Data category](https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus/tree/main/train)
92
+ - Pretrain:
93
+ - data item:
94
+ - json_name: {data_source}_{language}_{data_type}.json
95
+ - data_type: medicalBook, medicalGuideline, medicalPaper, medicalWeb(from online forum), medicalWiki
96
+ - language: en(English), zh(chinese), es(spanish), fr(french), hi(Hindi)
97
+ - data_type: qa(generated qa from text)
98
+ - data_type==text: list of string
99
+ ```
100
+ [
101
+ "string1",
102
+ "string2",
103
+ ...
104
+ ]
105
+ ```
106
+ - data_type==qa: list of qa pairs(list of string)
107
+ ```
108
+ [
109
+ [
110
+ "q1",
111
+ "a1",
112
+ "q2",
113
+ "a2",
114
+ ...
115
+ ],
116
+ ...
117
+ ]
118
+ ```
119
+ - SFT:
120
+ - json_name: {data_source}_{language}.json
121
+ - data_type: code, general, math, medicalExam, medicalPatient
122
+ - data item: list of qa pairs(list of string)
123
+ ```
124
+ [
125
+ [
126
+ "q1",
127
+ "a1",
128
+ "q2",
129
+ "a2",
130
+ ...
131
+ ],
132
+ ...
133
+ ]
134
+ ```
135
+
136
+
137
+ </details>
138
+
139
+
140
+
141
+ - Evaluation
142
+ 🤗 <a href="https://huggingface.co/datasets/FreedomIntelligence/XMedbench" target="_blank">XMedBench</a>
143
+
144
+ <details><summary>Click to expand</summary>
145
+
146
+ - EN:
147
+ - [MedQA-USMLE](https://huggingface.co/datasets/GBaker/MedQA-USMLE-4-options)
148
+ - [MedMCQA](https://huggingface.co/datasets/medmcqa/viewer/default/test)
149
+ - [PubMedQA](https://huggingface.co/datasets/pubmed_qa): Because the results fluctuated too much, they were not used in the paper.
150
+ - [MMLU-Medical](https://huggingface.co/datasets/cais/mmlu)
151
+ - Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
152
+ - ZH:
153
+ - [MedQA-MCMLE](https://huggingface.co/datasets/bigbio/med_qa/viewer/med_qa_zh_4options_bigbio_qa/test)
154
+ - [CMB-single](https://huggingface.co/datasets/FreedomIntelligence/CMB): Not used in the paper
155
+ - Randomly sample 2,000 multiple-choice questions with single answer.
156
+ - [CMMLU-Medical](https://huggingface.co/datasets/haonan-li/cmmlu)
157
+ - Anatomy, Clinical_knowledge, College_medicine, Genetics, Nutrition, Traditional_chinese_medicine, Virology
158
+ - [CExam](https://github.com/williamliujl/CMExam): Not used in the paper
159
+ - Randomly sample 2,000 multiple-choice questions
160
+
161
+
162
+ - ES: [Head_qa](https://huggingface.co/datasets/head_qa)
163
+ - FR: [Frenchmedmcqa](https://github.com/qanastek/FrenchMedMCQA)
164
+ - HI: [MMLU_HI](https://huggingface.co/datasets/FreedomIntelligence/MMLU_Arabic)
165
+ - Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
166
+ - AR: [MMLU_Ara](https://huggingface.co/datasets/FreedomIntelligence/MMLU_Hindi)
167
+ - Clinical knowledge, Medical genetics, Anatomy, Professional medicine, College biology, College medicine
168
+
169
+
170
+ </details>
171
+
172
+
173
+ ## Results reproduction
174
+ <details><summary>Click to expand</summary>
175
+
176
+ **Waiting for Update**
177
+
178
+
179
+
180
+ </details>
181
+
182
+
183
+
184
+
185
+ ## Citation
186
+ Please use the following citation if you intend to use our dataset for training or evaluation:
187
+
188
+ ```
189
+ @misc{wang2024apollo,
190
+ title={Apollo: Lightweight Multilingual Medical LLMs towards Democratizing Medical AI to 6B People},
191
+ author={Xidong Wang and Nuo Chen and Junyin Chen and Yan Hu and Yidong Wang and Xiangbo Wu and Anningzhe Gao and Xiang Wan and Haizhou Li and Benyou Wang},
192
+ year={2024},
193
+ eprint={2403.03640},
194
+ archivePrefix={arXiv},
195
+ primaryClass={cs.CL}
196
+ }
197
+ ```
198
+
199
+