README.md

---
datasets:
- tdro-llm/finetune_data
pipeline_tag: sentence-similarity
tags:
- sentence-transformers
base_model:
- Qwen/Qwen1.5-0.5B
---

# s0-baseline-Qwen1.5-0.5B

[![arxiv](https://img.shields.io/badge/arXiv-2404.05961-b31b1b.svg)](https://arxiv.org/abs/2408.10613)

[tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval](https://arxiv.org/abs/2408.10613). Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.


This is a fine-tuned **baseline retriever** with **uniform sampling weights** of [tdro-llm/finetune_data](https://huggingface.co/datasets/tdro-llm/finetune_data). This model is also used as a **reference model** in tDRO.