chaima01 commited on
Commit
17a7cf3
·
verified ·
1 Parent(s): 110f6c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +44 -3
README.md CHANGED
@@ -1,3 +1,44 @@
1
- ---
2
- license: openrail
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: openrail
4
+ datasets:
5
+ - custom_pilgrims_dataset
6
+ tags:
7
+ - wizardlm
8
+ - lora
9
+ - finetuned
10
+ - conversational
11
+ - assistant
12
+ pipeline_tag: text-generation
13
+ ---
14
+
15
+ # WizardLM Fine-Tuned on Pilgrims Dataset
16
+
17
+ This model is a fine-tuned version of [TheBloke/wizardLM-7B-HF](https://huggingface.co/TheBloke/wizardLM-7B-HF) using QLoRA on a custom dataset designed around spiritual, philosophical, and existential questions.
18
+
19
+ ---
20
+
21
+ ## Model Description
22
+
23
+ - **Base Model:** WizardLM 7B (HF format)
24
+ - **Fine-tuning Method:** QLoRA (Quantized Low-Rank Adaptation)
25
+ - **Training Data:** Custom pilgrims dataset (e.g. `Vibe: Atheist\nQuestion: How can I...`)
26
+ - **Intended Use:** Conversational assistant for users exploring personal meaning, spiritual identity, or philosophical reflection.
27
+
28
+ ---
29
+
30
+ ## Usage Example
31
+
32
+ ```python
33
+ from transformers import AutoModelForCausalLM, AutoTokenizer
34
+
35
+ model = AutoModelForCausalLM.from_pretrained("chaima01/wizard-pilgrims-finetuned")
36
+ tokenizer = AutoTokenizer.from_pretrained("chaima01/wizard-pilgrims-finetuned")
37
+
38
+ input_text = "#### Human: Vibe: Atheist\nQuestion: How can I really get to know who I am beyond all the labels and roles I’ve taken on?"
39
+ inputs = tokenizer(input_text, return_tensors="pt").to(model.device)
40
+
41
+ outputs = model.generate(
42
+ inputs.input_ids,
43
+ max_new_tokens=256,
44
+ temperature=0.7,