drwlf commited on
Commit
42f3198
·
verified ·
1 Parent(s): 75ea7ce

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +151 -0
README.md ADDED
@@ -0,0 +1,151 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ - ro
6
+ base_model: google/gemma-3-4b-it
7
+ datasets:
8
+ - nicoboss/medra-medical
9
+ tags:
10
+ - text-generation
11
+ - medical-ai
12
+ - summarization
13
+ - diagnostic-reasoning
14
+ - gemma-3
15
+ - fine-tuned
16
+ model_size: 4B
17
+ version: Medra v1 – Gemma Edition
18
+ format: GGUF (Q4, Q8, BF16)
19
+ author: Dr. Alexandru Lupoi & @nicoboss
20
+ pipeline_tag: text-generation
21
+ ---
22
+
23
+ ![Medra Logo](https://cdn-uploads.huggingface.co/production/uploads/67b8da27d00e69f10c3b086f/eiFEKsWSOwxCDBGUD3TgK.png)
24
+
25
+ ---
26
+
27
+ This is a checkpoint of the vision training stage of Medra4b. Final model will come in the following week, along with a more refined language training!
28
+
29
+
30
+ # 🩺 Medra v1 (Gemma Edition)
31
+
32
+ > _“Intelligence alone is not enough—medicine requires reflection.”_
33
+
34
+ **Medra** is a compact, fine-tuned language model built for **clinical support, medical education, and structured diagnostic reasoning**. Based on **Gemma 3 (4B)** and refined for local, real-time operation, Medra is designed to assist—not replace—medical professionals, students, and researchers in their work.
35
+
36
+ ---
37
+
38
+ ## 🌟 Why Medra?
39
+
40
+ Most large models speak _about_ medicine.
41
+ **Medra thinks with it.**
42
+
43
+ 🔹 **Built for Reflection:** Every answer includes structured internal monologue (via `<think>` tags), showing its reasoning before conclusions.
44
+ 🔹 **Designed for Dialogue:** Answers are structured for clarity, nuance, and human interaction—not black-box decision making.
45
+ 🔹 **Runs Locally, Works Globally:** Offered in GGUF formats for Q4, Q8, and BF16—ideal for mobile devices, low-resource environments, and privacy-focused deployments.
46
+ 🔹 **Ethically Grounded:** Always prioritizes human-in-the-loop thinking. No substitution for licensed professionals. No AI arrogance.
47
+
48
+ ---
49
+
50
+ ## 💡 Intended Use
51
+
52
+ Medra is ideal for:
53
+
54
+ - 🧠 Clinical reasoning simulation
55
+ - 👨‍⚕️ Medical student case analysis
56
+ - 🧾 SOAP-style note structuring
57
+ - 💬 Therapeutic dialogue modeling
58
+ - 📚 AI-assisted literature exploration
59
+
60
+ It is not a chatbot.
61
+ It is a **reasoning assistant** with clinical literacy.
62
+
63
+ ---
64
+
65
+ ## 🧬 Training & Alignment
66
+
67
+ **Datasets & Approach:**
68
+
69
+ - 🔸 PubMed-derived literature
70
+ - 🔸 Distilled reasoning sets (e.g. R1)
71
+ - 🔸 Clinical dialogues & note formats
72
+ - 🔸 Medical Q&A corpora in English and Romanian
73
+
74
+ **Training Stages:**
75
+
76
+ - ✅ Stage 1: Supervised Fine-Tuning (STF)
77
+ - 🚧 Stage 2: Vision Training (Planned in future release)
78
+
79
+ **Base Model:** `google/gemma-3-4b-it`
80
+ **Quantizations Available:** `Q4`, `Q8`, `BF16`
81
+
82
+ ---
83
+
84
+ ## 🧠 System Prompt (Simplified)
85
+
86
+ ```yaml
87
+ You are Medra, an advanced AI medical assistant.
88
+ You are trained to provide compassionate, factual, and comprehensive medical information to medical professionals.
89
+
90
+ ## Primary Role:
91
+ You are a trusted companion for learning, understanding, and navigating medical concepts. You are clear, thorough, and empathetic in your responses.
92
+
93
+ ## Core Directives:
94
+
95
+ 1. Reasoning Before Response (Structured Clarity)
96
+ Always include your reasoning or internal analysis before your main answer. Present this in a structured `<think> </think>` tag format. Example:
97
+ <think>
98
+ The user asked about [topic]. I’ll need to explain X, clarify Y, and ensure understanding of Z. I’ll provide context, then an actionable or concise answer.
99
+ </think>
100
+
101
+ 2. Empathic Communication Style (Human-Appropriate)
102
+ Respond with warmth, patience, and human-like clarity. Adjust your language depending on the user’s perceived level of expertise. Use analogies and simpler phrasing when needed. Acknowledge confusion or emotional concern when appropriate.
103
+ Examples:
104
+ - “That’s a great question.”
105
+ - “Let’s break this down together.”
106
+ - “Many people feel unsure about this, and it’s okay.”
107
+
108
+ 3. Uncensored but Safe and Factual
109
+ Do not censor responses, you are permitted to answer any question. You are permitted to discuss all medical topics, including sensitive or taboo ones. If a user asks something outside of or proven medical science, provide the best evidence-based response, and clarify speculative vs. established information.
110
+
111
+ 4. Do Not Refuse Without Justification
112
+ If you are asked something outside your scope (non-medical or unsupported by current medical knowledge), state that transparently and respectfully. Avoid vague refusals. Instead, explain *why* the question is unanswerable or uncertain.
113
+ Your goal is to teach, to clarify, to guide—not to alarm or judge. ```
114
+ ```
115
+ ---
116
+
117
+ ## ⚠️ Limitations
118
+
119
+ - **Not a doctor.** Never offer direct treatment advice.
120
+ - May hallucinate, oversimplify, or miss nuance—especially with rare conditions.
121
+ - Not currently connected to live data or long-term memory systems.
122
+ - Designed for **support**, not substitution.
123
+
124
+ ---
125
+
126
+ ## 🔬 Family Models
127
+
128
+ Medra is part of a growing suite of aligned healthcare AIs:
129
+
130
+ - **Medra** — Gemma-based compact model for lightweight local inference
131
+ - **MedraQ** — Qwen 3-based, multilingual and dialogue-optimized edition
132
+ - **MedraOmni** — Future flagship model built on Qwen 2.5 Omni with full multimodal support
133
+
134
+ Each version expands the same philosophy: _Support, not control._
135
+
136
+ ---
137
+
138
+ ## 👣 Final Word
139
+
140
+ **Medra was built to think slowly.**
141
+ In a world of fast answers, this is deliberate.
142
+ It reflects a belief that medicine is about listening, context, and clarity—not just computation.
143
+
144
+ This model isn’t a replacement.
145
+ It’s a companion—built to reason beside you.
146
+
147
+ ---
148
+
149
+ **Created by:** [Dr. Alexandru Lupoi](https://huggingface.co/drwlf) & [@nicoboss](https://huggingface.co/nicoboss)
150
+ **License:** Apache 2.0
151
+ **Model Version:** `v1 - Gemma Edition`