Edit Models filters

trl-lib/ultrafeedback_binarized

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

HuggingFaceH4/ultrafeedback_binarized

teknium/OpenHermes-2.5

fka/awesome-chatgpt-prompts

HuggingFaceH4/ultrachat_200k

microsoft/orca-math-word-problems-200k

cis-lmu/Glot500

Open-Orca/OpenOrca

allenai/MADLAD-400

m-a-p/CodeFeedback-Filtered-Instruction

bigcode/starcoderdata

cognitivecomputations/dolphin-coder

cerebras/SlimPajama-627B

Intel/orca_dpo_pairs

jondurbin/gutenberg-dpo-v0.1

oscar-corpus/OSCAR-2109

Open-Orca/SlimOrca

garage-bAInd/Open-Platypus

TIGER-Lab/MathInstruct

meta-math/MetaMathQA

cognitivecomputations/samantha-data

legacy-datasets/wikipedia

databricks/databricks-dolly-15k

mozilla-foundation/common_voice_13_0

jondurbin/truthy-dpo-v0.1

OpenAssistant/oasst1

tiiuae/falcon-refinedweb

jondurbin/airoboros-2.2.1

EleutherAI/pile

allenai/ultrafeedback_binarized_cleaned

jondurbin/airoboros-3.2

lmsys/lmsys-chat-1m

facebook/voxpopuli

anthracite-org/kalo-opus-instruct-22k-no-refusal

teknium/openhermes

migtissera/Synthia-v1.3

togethercomputer/RedPajama-Data-1T

cognitivecomputations/Dolphin-2.9

ise-uiuc/Magicoder-Evol-Instruct-110K

Gryphe/Sonnet3.5-Charcard-Roleplay

nothingiisreal/Reddit-Dirty-And-WritingPrompts

m-a-p/Code-Feedback

mozilla-foundation/common_voice_17_0

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

internlm/Agent-FLAN

Locutusque/function-calling-chatml

Vezora/Tested-22k-Python-Alpaca

yahma/alpaca-cleaned

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

nvidia/HelpSteer

HuggingFaceFW/fineweb

wikimedia/wikipedia

jondurbin/cinematika-v0.1

Anthropic/hh-rlhf

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

tatsu-lab/alpaca

glaiveai/glaive-function-calling-v2

codeparrot/apps

AI-MO/NuminaMath-CoT

mlabonne/orpo-dpo-mix-40k

Muennighoff/natural-instructions

argilla/distilabel-intel-orca-dpo-pairs

unalignment/toxic-dpo-v0.2

microsoft/orca-agentinstruct-1M-v1

mozilla-foundation/common_voice_8_0

huggan/smithsonian_butterflies_subset

ise-uiuc/Magicoder-OSS-Instruct-75K

camel-ai/biology

facebook/belebele

anthracite-org/nopm_claude_writing_fixed

camel-ai/physics

HuggingFaceTB/smoltalk

Nopm/Opus_WritingStruct

camel-ai/chemistry

HuggingFaceFW/fineweb-edu

HuggingFaceH4/no_robots

allura-org/Celeste-1.x-data-mixture

Gryphe/ChatGPT-4o-Writing-Prompts

grimulkan/LimaRP-augmented

nbeerbower/gutenberg2-dpo

kingbri/PIPPA-shareGPT

Models

100

Full-text search

Active filters: trl-lib/ultrafeedback_binarized

trl-lib/Qwen2-0.5B-ORPO

Text Generation • Updated Oct 11, 2024 • 257 • 2

hxssgaa/llama-3-8b-dpo-full

Text Generation • Updated Oct 8, 2024 • 8

qgallouedec/Qwen2.5-7B-DPO-2209

Text Generation • Updated Oct 21, 2024 • 2

qgallouedec/Qwen2.5-7B-DPO-main

Text Generation • Updated Oct 21, 2024 • 2

JayHyeon/Qwen2-0.5B-Reward-ds1

Text Classification • Updated Nov 28, 2024 • 110

JayHyeon/Qwen2-0.5B-Reward_VPO_1e-4

Text Classification • Updated Nov 28, 2024 • 7

JayHyeon/Qwen2-0.5B-Reward_5e-4

Text Classification • Updated Nov 28, 2024 • 105

JayHyeon/Qwen2-0.5B-Reward_VPO_5e-4

Text Classification • Updated Nov 28, 2024 • 105

JayHyeon/Qwen2-0.5B-Reward_1e-3

Text Classification • Updated Nov 28, 2024 • 106

JayHyeon/Qwen2-0.5B-Reward_VPO_1e-3

Text Classification • Updated Nov 28, 2024 • 104

JayHyeon/Qwen2-0.5B-Reward_5e-3

Text Classification • Updated Nov 28, 2024 • 105

JayHyeon/Qwen2-0.5B-Reward_VPO_5e-3

Text Classification • Updated Nov 29, 2024 • 104

skaltenp/Qwen2-1.5B-DPO

Updated Dec 3, 2024

RLHF-And-Friends/Pythia-70M-Reward

Updated Dec 18, 2024

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-5ep-MDPO_5e-7_3ep_0alp_0lam

Text Generation • Updated Dec 30, 2024 • 138

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-5ep-MDPO_7e-7_3ep_0alp_0lam

Text Generation • Updated Dec 31, 2024 • 138

JayHyeon/Test-MDPO_5e-7-1ep_0alp_0lam

Text Generation • Updated Jan 1 • 139

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_5e-7-3ep_0alp_0lam

Text Generation • Updated Jan 3 • 5

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_7e-7-3ep_0alp_0lam

Text Generation • Updated Dec 31, 2024 • 143

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_1e-6-3ep_0alp_0lam

Text Generation • Updated Dec 31, 2024 • 147

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_2e-6-3ep_0alp_0lam

Text Generation • Updated Jan 1 • 139

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_1e-6-3ep_0alp_0lam

Text Generation • Updated Jan 1 • 142

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_5e-6-3ep_0alp_0lam

Text Generation • Updated Jan 2 • 144

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_3e-6-3ep_0alp_0lam

Text Generation • Updated Jan 1 • 141

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_2e-6-3ep_0alp_0lam

Text Generation • Updated Jan 1 • 141

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_5e-6-3ep_0alp_0lam

Text Generation • Updated Jan 1 • 143

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_3e-6-3ep_0alp_0lam

Text Generation • Updated Jan 1 • 145

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_5e-7-3ep_1alp_0lam

Text Generation • Updated Jan 2 • 139

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPOP_5e-7-3ep_0alp_5lam

Text Generation • Updated Jan 2 • 143

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPOP_5e-6-3ep_0alp_5lam

Text Generation • Updated Jan 2 • 143