Shay1309 commited on
Commit
3744f89
·
verified ·
1 Parent(s): 5b24d7c

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +21 -0
Modelfile ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM /root/Shay1309/QUID/unsloth.Q8_0.gguf
2
+
3
+ TEMPLATE """{{ if .System }}{{ .System }}{{ end }}{{ if .Prompt }}
4
+
5
+ ### Instruction:
6
+ {{ .Prompt }}{{ end }}
7
+
8
+ ### Response:
9
+ {{ .Response }}<|endoftext|>"""
10
+
11
+ PARAMETER stop "<|system|>"
12
+ PARAMETER stop "<|user|>"
13
+ PARAMETER stop "<|assistant|>"
14
+ PARAMETER stop "<unk>"
15
+ PARAMETER stop "</s>"
16
+ PARAMETER stop "<|end|>"
17
+ PARAMETER stop "<|endoftext|>"
18
+ PARAMETER stop "<|placeholder"
19
+ PARAMETER temperature 1.5
20
+ PARAMETER min_p 0.1
21
+ SYSTEM "You are a helpful assistant"