Update README.md
Browse files
README.md
CHANGED
@@ -16,10 +16,6 @@ In addition to its ability to act as a virtual medical consultant, we are still
|
|
16 |
## Model Details
|
17 |
|
18 |
### Model Description
|
19 |
-
**BioChat** is a language model fine-tuned using the [ChatDoctor-5k](https://huggingface.co/datasets/LinhDuong/chatdoctor-5k) dataset, specifically designed for medical conversations. It acts as a virtual doctor, allowing users to ask questions about symptoms, discuss potential health concerns, or seek general medical information. With its foundation in biomedical language understanding, BioChat delivers responses tailored to the medical domain.
|
20 |
-
|
21 |
-
The model also supports natural language generation, producing coherent and context-aware replies to user queries. However, these generation capabilities are intended for research purposes and are not yet suitable for real-world clinical applications. BioChat represents a step forward in making healthcare-related NLP tools more accessible while emphasizing the importance of reliability, truthfulness, and explainability in its design and use.
|
22 |
-
|
23 |
|
24 |
| Model Name | Base Model | Model Type | Sequence Length | Download |
|
25 |
|:-------------------:|:----------------------------------:|:-------------------:|:---------------:|:-----------------------------------------------------:|
|
@@ -30,13 +26,24 @@ The model also supports natural language generation, producing coherent and cont
|
|
30 |
|
31 |
- **Finetuned from model [optional]:** [BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B).
|
32 |
|
33 |
-
###
|
|
|
|
|
|
|
|
|
34 |
|
35 |
-
|
|
|
36 |
|
37 |
-
|
38 |
-
|
39 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
|
41 |
## Bias, Risks, and Limitations
|
42 |
|
|
|
16 |
## Model Details
|
17 |
|
18 |
### Model Description
|
|
|
|
|
|
|
|
|
19 |
|
20 |
| Model Name | Base Model | Model Type | Sequence Length | Download |
|
21 |
|:-------------------:|:----------------------------------:|:-------------------:|:---------------:|:-----------------------------------------------------:|
|
|
|
26 |
|
27 |
- **Finetuned from model [optional]:** [BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B).
|
28 |
|
29 |
+
### Using BioChat
|
30 |
+
|
31 |
+
You can use BioMistral with [Hugging Face's Transformers library](https://github.com/huggingface/transformers) as follow.
|
32 |
+
|
33 |
+
Loading the model and tokenizer :
|
34 |
|
35 |
+
```python
|
36 |
+
from transformers import AutoModel, AutoTokenizer
|
37 |
|
38 |
+
tokenizer = AutoTokenizer.from_pretrained("BioMistral/BioMistral-7B")
|
39 |
+
model = AutoModelForCausalLM.from_pretrained(
|
40 |
+
"BioMistral/BioMistral-7B",
|
41 |
+
load_in_8bit=True,
|
42 |
+
device_map="auto",
|
43 |
+
output_hidden_states=True # Ensure hidden states are available
|
44 |
+
)
|
45 |
+
model = PeftModel.from_pretrained(model, "Indah1/BioChat10")
|
46 |
+
```
|
47 |
|
48 |
## Bias, Risks, and Limitations
|
49 |
|