Update README.md
Browse files
README.md
CHANGED
@@ -31,30 +31,14 @@ Inspired by and featuring the Reflection Tuning technique (Published by Matt Shu
|
|
31 |
|
32 |
From the author of the first "reflection tuned" Llama 3.1 8B LLM.
|
33 |
|
34 |
-
|
35 |
|
36 |
-
""
|
37 |
-
|
38 |
-
During sampling, the model will start by outputting reasoning inside and tags, and then once it is satisfied with its reasoning, it will output the final answer inside and tags. Each of these tags are special tokens, trained into the model.
|
39 |
-
|
40 |
-
This enables the model to separate its internal thoughts and reasoning from its final answer, improving the experience for the user.
|
41 |
|
42 |
-
|
43 |
-
|
44 |
-
System Prompt: The system prompt used for training this model is:
|
45 |
|
46 |
You are a world-class AI system, capable of complex reasoning and reflection. Reason through the query inside tags, and then provide your final response inside tags. If you detect that you made a mistake in your reasoning at any point, correct yourself inside tags.
|
47 |
|
48 |
-
We recommend using this exact system prompt to get the best results from Reflection Llama-3.1 70B. You may also want to experiment combining this system prompt with your own custom instructions to customize the behavior of the model.
|
49 |
-
|
50 |
-
Chat Format: As mentioned above, the model uses the standard Llama 3.1 chat format. Here’s an example:
|
51 |
-
|
52 |
-
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
53 |
-
|
54 |
-
You are a world-class AI system, capable of complex reasoning and reflection. Reason through the query inside tags, and then provide your final response inside tags. If you detect that you made a mistake in your reasoning at any point, correct yourself inside tags.<|eot_id|><|start_header_id|>user<|end_header_id|>
|
55 |
-
|
56 |
-
what is 2+2?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
57 |
-
|
58 |
"""
|
59 |
|
60 |
**Example of this model in action:**
|
|
|
31 |
|
32 |
From the author of the first "reflection tuned" Llama 3.1 8B LLM.
|
33 |
|
34 |
+
Due to the method fo data structuring and training implemented in this model fine-tune, the following
|
35 |
|
36 |
+
As per one of the inspiring model "mattshumer/Reflection-Llama-3.1-70B" (this model was not used in the training process nor as a foundational model, but only served as inspiration) this model may benefit from this master prompt:
|
|
|
|
|
|
|
|
|
37 |
|
38 |
+
"""
|
|
|
|
|
39 |
|
40 |
You are a world-class AI system, capable of complex reasoning and reflection. Reason through the query inside tags, and then provide your final response inside tags. If you detect that you made a mistake in your reasoning at any point, correct yourself inside tags.
|
41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
"""
|
43 |
|
44 |
**Example of this model in action:**
|