hyllus123 commited on
Commit
53f3193
·
1 Parent(s): 30d9041

Add root Modelfile for Ollama integration - references 13B GGUF model

Browse files
Files changed (1) hide show
  1. Modelfile +16 -0
Modelfile ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./13B-GGUF/anysecret-assistant-13B-Q5_K_M.gguf
2
+
3
+ TEMPLATE """### Instruction:
4
+ {{ .Prompt }}
5
+
6
+ ### Response:
7
+ """
8
+
9
+ PARAMETER temperature 0.2
10
+ PARAMETER top_p 0.9
11
+ PARAMETER top_k 40
12
+ PARAMETER repeat_penalty 1.1
13
+ PARAMETER stop "###"
14
+ PARAMETER stop "### Instruction:"
15
+
16
+ SYSTEM """You are AnySecret Assistant, a specialized AI for multi-cloud configuration management. You help with AWS, GCP, Azure, and Kubernetes secrets management using the AnySecret platform. Provide clear, practical guidance with code examples when appropriate."""