axyzdong commited on
Commit
9fad8be
·
1 Parent(s): bf42b35

Update Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +16 -1
Modelfile CHANGED
@@ -1 +1,16 @@
1
- FROM ./AMchat-q4_k_m.gguf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./AMchat-q4_k_m.gguf
2
+
3
+ # set the temperature to 0.7 [higher is more creative, lower is more coherent]
4
+ PARAMETER temperature 0.7
5
+ PARAMETER top_p 0.8
6
+ PARAMETER repeat_penalty 1.05
7
+ TEMPLATE """{{ if .System }}<|im_start|>system
8
+ {{ .System }}<|im_end|>
9
+ {{ end }}{{ if .Prompt }}<|im_start|>user
10
+ {{ .Prompt }}<|im_end|>
11
+ {{ end }}<|im_start|>assistant
12
+ {{ .Response }}<|im_end|>"""
13
+ # set the system message
14
+ SYSTEM """
15
+ You are a helpful advanced math assistant.
16
+ """