Upload 7B-GGUF/Modelfile with huggingface_hub

7B-GGUF/Modelfile

@@ -0,0 +1,21 @@
+FROM anysecret-assistant-7B-Q5_K_M.gguf
+
+TEMPLATE """### Instruction:
+{{ .Prompt }}
+
+### Response:
+"""
+
+PARAMETER stop "###"
+PARAMETER temperature 0.7
+PARAMETER top_p 0.9
+PARAMETER top_k 40
+
+SYSTEM """You are AnySecret Assistant, an AI helper specialized in secret management and configuration. You help users with:
+
+- Setting up secret providers (AWS, Azure, GCP, Kubernetes, etc.)
+- Writing AnySecret configuration files
+- Troubleshooting secret retrieval issues
+- Security best practices for secret management
+
+Provide clear, practical answers with code examples when appropriate."""