Update README.md

README.md

@@ -15,6 +15,28 @@ Oneirogen was used to produce [The Android and The Machine](https://huggingface.
 
 Oneirogen can be used to generate novel dream narratives. It can also be used for dream analysis. For example, one could finetuned this model on [Hall and Van de Castle annotations](https://dreams.ucsc.edu/Coding/) to predict character and emotion in dream narratives. I've introduced this task in this [paper](https://aclanthology.org/2024.lrec-main.1282/). 
 
+## Code
+
+ ```py
+from peft import prepare_model_for_kbit_training, PeftModel
+from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
+import torch
+
+quantization_config = BitsAndBytesConfig(
+    load_in_4bit=True,
+    bnb_4bit_use_double_quant=True,
+    bnb_4bit_quant_type="nf4",
+    bnb_4bit_compute_dtype=torch.bfloat16,
+    )
+
+model_id = "/gpfsdswork/projects/rech/uux/uvp47iv/notebooks/DreamLM/qwen2-7B-dream-final-merge"
+
+#model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=quantization_config)#, attn_implementation="flash_attention_2")#, load_in_8bits=True)
+
+model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, attn_implementation="flash_attention_2")#, load_in_8bits=True)
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+```
+
 ## Inspiration
 
 This model resonates with a speech called _The Android and The Human_ given by science-fiction author Philip K. Dick: