drwlf
commited on
Commit
·
8552479
1
Parent(s):
bd95447
Add MiniMedra 0.6b fine-tuned medical model with LFS
Browse files- .gitattributes +1 -0
- README.md +52 -0
- added_tokens.json +3 -0
- config.json +3 -0
- generation_config.json +3 -0
- merges.txt +0 -0
- model.safetensors +3 -0
- special_tokens_map.json +3 -0
- tokenizer.json +3 -0
- tokenizer_config.json +3 -0
- vocab.json +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
*.json filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
tags:
|
4 |
+
- medical
|
5 |
+
- healthcare
|
6 |
+
- fine-tuned
|
7 |
+
- gemma
|
8 |
+
license: apache-2.0
|
9 |
+
base_model: microsoft/DialoGPT-small
|
10 |
+
model_type: gemma
|
11 |
+
---
|
12 |
+
|
13 |
+
# MiniMedra 0.6b
|
14 |
+
|
15 |
+
MiniMedra 0.6b is a fine-tuned medical language model based on Gemma 0.6b architecture. This model has been specifically trained for medical and healthcare-related tasks.
|
16 |
+
|
17 |
+
## Model Details
|
18 |
+
|
19 |
+
- **Base Model**: Gemma 0.6b
|
20 |
+
- **Fine-tuning**: LoRA (Low-Rank Adaptation)
|
21 |
+
- **Domain**: Medical/Healthcare
|
22 |
+
- **Parameters**: ~0.6 billion
|
23 |
+
- **Format**: SafeTensors
|
24 |
+
|
25 |
+
## Training
|
26 |
+
|
27 |
+
This model was fine-tuned using Axolotl with LoRA adapters on medical datasets. The training focused on improving the model's understanding and generation capabilities for medical content.
|
28 |
+
|
29 |
+
## Usage
|
30 |
+
|
31 |
+
```python
|
32 |
+
from transformers import AutoTokenizer, AutoModelForCausalLM
|
33 |
+
|
34 |
+
tokenizer = AutoTokenizer.from_pretrained("drwlf/MiniMedra-0.6b")
|
35 |
+
model = AutoModelForCausalLM.from_pretrained("drwlf/MiniMedra-0.6b")
|
36 |
+
|
37 |
+
# Example usage
|
38 |
+
input_text = "What are the symptoms of diabetes?"
|
39 |
+
inputs = tokenizer.encode(input_text, return_tensors="pt")
|
40 |
+
outputs = model.generate(inputs, max_length=100, temperature=0.7)
|
41 |
+
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
|
42 |
+
print(response)
|
43 |
+
```
|
44 |
+
|
45 |
+
## License
|
46 |
+
|
47 |
+
Apache 2.0
|
48 |
+
|
49 |
+
## Disclaimer
|
50 |
+
|
51 |
+
This model is for research and educational purposes only. It should not be used as a substitute for professional medical advice, diagnosis, or treatment. Always consult with qualified healthcare professionals for medical concerns.
|
52 |
+
|
added_tokens.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680
|
3 |
+
size 707
|
config.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8124b5919db0bab7659bd2c4dc561b363afbaecb02bf53b9240dfc273e49e732
|
3 |
+
size 701
|
generation_config.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:81051cd3f6e77013827148d0b8a6ead93f8ac390d5ab805f849199f0af6a08db
|
3 |
+
size 214
|
merges.txt
ADDED
The diff for this file is too large to render.
See raw diff
|
|
model.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5b92788a07d597ce407e20dd3f15eee67e31e16ee0d763cdb35f333fbdb46c1c
|
3 |
+
size 1192135096
|
special_tokens_map.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
|
3 |
+
size 613
|
tokenizer.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
|
3 |
+
size 11422654
|
tokenizer_config.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3c0884a30471f4f542dc89630f62a380bb70a341fafda826136a7be921fec7ea
|
3 |
+
size 9762
|
vocab.json
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
|
3 |
+
size 2776833
|