Tool-Calling Format

#12
by G-reen - opened

Whats the correct way to do tool calls on QwQ?

The ollama suggested template is formatting it like this, maybe that can help:

{{- else if .ToolCalls }}<tool_call>
{{ range .ToolCalls }}{"name": "{{ .Function.Name }}", "arguments": {{ .Function.Arguments }}}
{{ end }}</tool_call>
{{- end }}{{ if not $last }}<|im_end|>
{{ end }}
{{- else if eq .Role "tool" }}<|im_start|>user
<tool_response>
{{ .Content }}
</tool_response><|im_end|>

Sign up or log in to comment