Resources for EMNLP 2024 Paper: Calibrating LLMs with Preference Optimization on Thought Trees for Generating Rationale in Science Question Scoring
J Li
jiazhengli
AI & ML interests
None yet
Recent Activity
updated
a model
about 4 hours ago
jiazhengli/Qwen2.5-7B-RoleMRC-sft
updated
a model
about 4 hours ago
jiazhengli/Qwen2.5-7B-RoleMRC-dpo
updated
a model
about 4 hours ago
jiazhengli/Llama-3.1-8B-RoleMRC-sft
Organizations
None yet
Collections
3
Resources for EMNLP 2024 Paper: Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence
-
jiazhengli/Pythia-2.8B-HH-RLHF-Iterative-SamPO
Text Generation • Updated • 33 -
jiazhengli/Pythia-2.8B-TLDR-Iterative-SamPO
Text Generation • Updated • 36 -
Junrulu/Llama-3-8B-Instruct-Iterative-SamPO
Text Generation • Updated • 11 • 1 -
Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence
Paper • 2406.10957 • Published • 1
models
12
jiazhengli/Qwen2.5-7B-RoleMRC-sft
Updated
•
4
jiazhengli/Qwen2.5-7B-RoleMRC-dpo
Updated
•
5
jiazhengli/Llama-3.1-8B-RoleMRC-sft
Updated
•
8
jiazhengli/Llama-3.1-8B-RoleMRC-dpo
Updated
•
6
jiazhengli/long-t5-tglobal-large-AERA
Text2Text Generation
•
Updated
•
23
jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-dpo
Updated
•
9
jiazhengli/Mixtral-8x7B-Instruct-v0.1-QLoRA-Assessment-Rationale-sft
Updated
•
5
jiazhengli/Meta-Llama-3-8B-QLoRA-Assessment-Rationale-sft
Updated
•
7
jiazhengli/Meta-Llama-3-8B-QLoRA-Assessment-Rationale-dpo
Updated
•
9
•
1
jiazhengli/deberta-v3-large-Rationale-to-Score
Text Classification
•
Updated
•
114
•
1