W4D
/

GGUF
Inference Endpoints
conversational
File size: 429 Bytes
4557234
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
FROM {__FILE_LOCATION__}

TEMPLATE """Below are some instructions that describe some tasks. Write responses that appropriately complete each request.{{ if .Prompt }}

### Instruction:
{{ .Prompt }}{{ end }}

### Response:
{{ .Response }}</s>"""

PARAMETER stop "<unk>"
PARAMETER stop "</s>"
PARAMETER temperature 0.5
PARAMETER min_p 0.05
PARAMETER top_p 0.9
PARAMETER top_k 40
PARAMETER repeat_penalty 1.1
PARAMETER num_ctx 8192