Update README.md
Browse files
README.md
CHANGED
@@ -144,7 +144,8 @@ Tülu3 is designed for state-of-the-art performance on a diversity of tasks in a
|
|
144 |
|-----------|-------------------|
|
145 |
| **Base Model** | [meta-llama/llama-3.1-405B](https://huggingface.co/meta-llama/llama-3.1-405B) |
|
146 |
| **SFT** | [allenai/llama-3.1-Tulu-3-405B-SFT](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B-SFT) |
|
147 |
-
| **
|
|
|
148 |
| **Reward Model (RM)**| (Same as 8B)
|
149 |
|
150 |
|
|
|
144 |
|-----------|-------------------|
|
145 |
| **Base Model** | [meta-llama/llama-3.1-405B](https://huggingface.co/meta-llama/llama-3.1-405B) |
|
146 |
| **SFT** | [allenai/llama-3.1-Tulu-3-405B-SFT](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B-SFT) |
|
147 |
+
| **DPO** | [allenai/llama-3.1-Tulu-3-405B-DPO](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B-DPO) |
|
148 |
+
| **Final Model (RLVR)** | [allenai/llama-3.1-Tulu-3-405B](https://huggingface.co/allenai/llama-3.1-Tulu-3-405B) |
|
149 |
| **Reward Model (RM)**| (Same as 8B)
|
150 |
|
151 |
|