Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- tdro-llm/finetune_data
|
4 |
+
pipeline_tag: sentence-similarity
|
5 |
+
tags:
|
6 |
+
- sentence-transformers
|
7 |
+
base_model:
|
8 |
+
- Qwen/Qwen1.5-0.5B
|
9 |
+
---
|
10 |
+
|
11 |
+
# s0-baseline-Qwen1.5-0.5B
|
12 |
+
|
13 |
+
[](https://arxiv.org/abs/2408.10613)
|
14 |
+
|
15 |
+
[tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval](https://arxiv.org/abs/2408.10613). Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.
|
16 |
+
|
17 |
+
|
18 |
+
This is a fine-tuned **baseline retriever** with **uniform sampling weights** of [tdro-llm/finetune_data](https://huggingface.co/datasets/tdro-llm/finetune_data). This model is also used as a **reference model** in tDRO.
|
19 |
+
|
20 |
+
|
21 |
+
|