JingyaoLi commited on
Commit
b0fd106
Β·
verified Β·
1 Parent(s): 932cca7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -19,8 +19,8 @@ should probably proofread and complete it, then remove this comment. -->
19
  β€’ πŸ€— <a href="https://huggingface.co/datasets/JingyaoLi/Science-Logits-1.2M" target="_blank">Data </a>
20
  β€’ πŸ€— <a href="https://huggingface.co/JingyaoLi/ScienceLLaMA-3b" target="_blank">ScienceLLaMA-3B </a>
21
  β€’ πŸ€— <a href="https://huggingface.co/JingyaoLi/ScienceLLaMA-1b" target="_blank">ScienceLLaMA-1B </a>
22
- β€’ 🐱 <a href="Logits-based Finetuning" target="_blank">Code</a>
23
- β€’ πŸ“ƒ Paper (TO be released) <br>
24
  </p>
25
 
26
  This model is a fine-tuned with **Logits-Based Finetuning** on the [JingyaoLi/Science-Logits-1.2M](https://huggingface.co/datasets/JingyaoLi/Science-Logits-1.2M), which integrates the strengths of supervised learning and knowledge distillation by combining teacher logits with ground truth labels. This preserves both correctness and linguistic diversity.
 
19
  β€’ πŸ€— <a href="https://huggingface.co/datasets/JingyaoLi/Science-Logits-1.2M" target="_blank">Data </a>
20
  β€’ πŸ€— <a href="https://huggingface.co/JingyaoLi/ScienceLLaMA-3b" target="_blank">ScienceLLaMA-3B </a>
21
  β€’ πŸ€— <a href="https://huggingface.co/JingyaoLi/ScienceLLaMA-1b" target="_blank">ScienceLLaMA-1B </a>
22
+ β€’ 🐱 <a href="https://github.com/dvlab-research/Logits-Based-Finetuning" target="_blank">Code</a>
23
+ β€’ πŸ“ƒ <a href="https://arxiv.org/abs/2505.24461" target="_blank">Paper</a>
24
  </p>
25
 
26
  This model is a fine-tuned with **Logits-Based Finetuning** on the [JingyaoLi/Science-Logits-1.2M](https://huggingface.co/datasets/JingyaoLi/Science-Logits-1.2M), which integrates the strengths of supervised learning and knowledge distillation by combining teacher logits with ground truth labels. This preserves both correctness and linguistic diversity.