drwlf commited on
Commit
8552479
·
1 Parent(s): bd95447

Add MiniMedra 0.6b fine-tuned medical model with LFS

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - medical
5
+ - healthcare
6
+ - fine-tuned
7
+ - gemma
8
+ license: apache-2.0
9
+ base_model: microsoft/DialoGPT-small
10
+ model_type: gemma
11
+ ---
12
+
13
+ # MiniMedra 0.6b
14
+
15
+ MiniMedra 0.6b is a fine-tuned medical language model based on Gemma 0.6b architecture. This model has been specifically trained for medical and healthcare-related tasks.
16
+
17
+ ## Model Details
18
+
19
+ - **Base Model**: Gemma 0.6b
20
+ - **Fine-tuning**: LoRA (Low-Rank Adaptation)
21
+ - **Domain**: Medical/Healthcare
22
+ - **Parameters**: ~0.6 billion
23
+ - **Format**: SafeTensors
24
+
25
+ ## Training
26
+
27
+ This model was fine-tuned using Axolotl with LoRA adapters on medical datasets. The training focused on improving the model's understanding and generation capabilities for medical content.
28
+
29
+ ## Usage
30
+
31
+ ```python
32
+ from transformers import AutoTokenizer, AutoModelForCausalLM
33
+
34
+ tokenizer = AutoTokenizer.from_pretrained("drwlf/MiniMedra-0.6b")
35
+ model = AutoModelForCausalLM.from_pretrained("drwlf/MiniMedra-0.6b")
36
+
37
+ # Example usage
38
+ input_text = "What are the symptoms of diabetes?"
39
+ inputs = tokenizer.encode(input_text, return_tensors="pt")
40
+ outputs = model.generate(inputs, max_length=100, temperature=0.7)
41
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
42
+ print(response)
43
+ ```
44
+
45
+ ## License
46
+
47
+ Apache 2.0
48
+
49
+ ## Disclaimer
50
+
51
+ This model is for research and educational purposes only. It should not be used as a substitute for professional medical advice, diagnosis, or treatment. Always consult with qualified healthcare professionals for medical concerns.
52
+
added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680
3
+ size 707
config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8124b5919db0bab7659bd2c4dc561b363afbaecb02bf53b9240dfc273e49e732
3
+ size 701
generation_config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81051cd3f6e77013827148d0b8a6ead93f8ac390d5ab805f849199f0af6a08db
3
+ size 214
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b92788a07d597ce407e20dd3f15eee67e31e16ee0d763cdb35f333fbdb46c1c
3
+ size 1192135096
special_tokens_map.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
3
+ size 613
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
3
+ size 11422654
tokenizer_config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c0884a30471f4f542dc89630f62a380bb70a341fafda826136a7be921fec7ea
3
+ size 9762
vocab.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
3
+ size 2776833