Indah1 commited on
Commit
6871c5c
·
verified ·
1 Parent(s): 43155b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -9
README.md CHANGED
@@ -16,10 +16,6 @@ In addition to its ability to act as a virtual medical consultant, we are still
16
  ## Model Details
17
 
18
  ### Model Description
19
- **BioChat** is a language model fine-tuned using the [ChatDoctor-5k](https://huggingface.co/datasets/LinhDuong/chatdoctor-5k) dataset, specifically designed for medical conversations. It acts as a virtual doctor, allowing users to ask questions about symptoms, discuss potential health concerns, or seek general medical information. With its foundation in biomedical language understanding, BioChat delivers responses tailored to the medical domain.
20
-
21
- The model also supports natural language generation, producing coherent and context-aware replies to user queries. However, these generation capabilities are intended for research purposes and are not yet suitable for real-world clinical applications. BioChat represents a step forward in making healthcare-related NLP tools more accessible while emphasizing the importance of reliability, truthfulness, and explainability in its design and use.
22
-
23
 
24
  | Model Name | Base Model | Model Type | Sequence Length | Download |
25
  |:-------------------:|:----------------------------------:|:-------------------:|:---------------:|:-----------------------------------------------------:|
@@ -30,13 +26,24 @@ The model also supports natural language generation, producing coherent and cont
30
 
31
  - **Finetuned from model [optional]:** [BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B).
32
 
33
- ### Model Sources [optional]
 
 
 
 
34
 
35
- <!-- Provide the basic links for the model. -->
 
36
 
37
- - **Repository:** [More Information Needed]
38
- - **Paper [optional]:** [More Information Needed]
39
- - **Demo [optional]:** [More Information Needed]
 
 
 
 
 
 
40
 
41
  ## Bias, Risks, and Limitations
42
 
 
16
  ## Model Details
17
 
18
  ### Model Description
 
 
 
 
19
 
20
  | Model Name | Base Model | Model Type | Sequence Length | Download |
21
  |:-------------------:|:----------------------------------:|:-------------------:|:---------------:|:-----------------------------------------------------:|
 
26
 
27
  - **Finetuned from model [optional]:** [BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B).
28
 
29
+ ### Using BioChat
30
+
31
+ You can use BioMistral with [Hugging Face's Transformers library](https://github.com/huggingface/transformers) as follow.
32
+
33
+ Loading the model and tokenizer :
34
 
35
+ ```python
36
+ from transformers import AutoModel, AutoTokenizer
37
 
38
+ tokenizer = AutoTokenizer.from_pretrained("BioMistral/BioMistral-7B")
39
+ model = AutoModelForCausalLM.from_pretrained(
40
+ "BioMistral/BioMistral-7B",
41
+ load_in_8bit=True,
42
+ device_map="auto",
43
+ output_hidden_states=True # Ensure hidden states are available
44
+ )
45
+ model = PeftModel.from_pretrained(model, "Indah1/BioChat10")
46
+ ```
47
 
48
  ## Bias, Risks, and Limitations
49