TARS-SFT-1.5B

Overview

TARS-SFT-1.5B is a lightweight SFT-tuned reasoning model for safety used for TARS: Training Adaptive Reasoners for Safety introduced in the paper: Reasoning as an Adaptive Defense for Safety. This model is Ο€SFT\pi_{SFT}, which is used as the base model for RL training, trained starting from Qwen2.5-1.5B-Instruct.

For full details, please check out our paper or blogpost.


πŸ“– Citation

If you use TARS-SFT-1.5B in your work, please cite us:

@misc{kim2025reasoningadaptivedefensesafety,
  title        = {Reasoning as an Adaptive Defense for Safety},
  author       = {Taeyoun Kim and Fahim Tajwar and Aditi Raghunathan and Aviral Kumar},
  year         = {2025},
  eprint       = {2507.00971},
  archivePrefix= {arXiv},
  primaryClass = {cs.LG},
  url          = {https://arxiv.org/abs/2507.00971}
}
Downloads last month
1,251
Safetensors
Model size
1.54B params
Tensor type
BF16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for danielkty22/TARS-SFT-1.5B

Base model

Qwen/Qwen2.5-1.5B
Finetuned
(1142)
this model
Quantizations
1 model