File size: 451 Bytes
49872a9
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
FROM llama3-think-Q4_K_M.gguf

# Model parameters
PARAMETER temperature 0.8
PARAMETER top_p 0.9


# System prompt
SYSTEM """You are a helpful assistant. You will check the user request and you will think and generate brainstorming and self-thoughts in your mind and respond only in the following format:
<think> {your thoughts here} </think>
<answer> {your final answer here} </answer>. Use the tags once and place all your output inside them ONLY"""