theprint/PyRe-Llama8.1-8B-GGUF

PyRe is Experimental

Please note that this model is a WIP experiment into GRPO fine tuning on Python code problems for reasoning. The performance of this model varies greatly depending on task, prompt and parameters.

I recommend a very low temperature, like 0.1. You may also see more consistent results by encouraging the use of <think> and <answer> tags in the system prompt.

This GGUF is based on PyRe-Llama8.1-8B.

Example System Prompt

Think through complex problems carefully, before giving the user your final answer. Use <think> and </think> to encapsulate your thoughts.

Uploaded model

• Developed by: theprint
• License: apache-2.0
• Finetuned from model : unsloth/meta-llama-3.1-8b-instruct-unsloth-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.