JayHyeon/Qwen_0.5-MDPO_0.5_7e-6-3ep_0alp_0lam
Text Generation
•
Updated
•
23
Edit Models filters
Datasets with no match
mozilla-foundation/common_voice_11_0
mozilla-foundation/common_voice_7_0
HuggingFaceH4/ultrafeedback_binarized
teknium/OpenHermes-2.5
fka/awesome-chatgpt-prompts
HuggingFaceH4/ultrachat_200k
microsoft/orca-math-word-problems-200k
cis-lmu/Glot500
Open-Orca/OpenOrca
marsyas/gtzan
allenai/MADLAD-400
m-a-p/CodeFeedback-Filtered-Instruction
allenai/c4
LDJnr/Capybara
bigcode/starcoderdata
cognitivecomputations/dolphin-coder
allenai/nllb
cerebras/SlimPajama-627B
Intel/orca_dpo_pairs
jondurbin/gutenberg-dpo-v0.1
oscar-corpus/OSCAR-2109
Open-Orca/SlimOrca
garage-bAInd/Open-Platypus
TIGER-Lab/MathInstruct
cognitivecomputations/samantha-data
meta-math/MetaMathQA
legacy-datasets/wikipedia
databricks/databricks-dolly-15k
mozilla-foundation/common_voice_13_0
jondurbin/truthy-dpo-v0.1
OpenAssistant/oasst1
tiiuae/falcon-refinedweb
jondurbin/airoboros-2.2.1
EleutherAI/pile
allenai/ultrafeedback_binarized_cleaned
jondurbin/airoboros-3.2
lmsys/lmsys-chat-1m
facebook/voxpopuli
anthracite-org/kalo-opus-instruct-22k-no-refusal
teknium/openhermes
google/fleurs
migtissera/Synthia-v1.3
togethercomputer/RedPajama-Data-1T
PolyAI/minds14
cognitivecomputations/Dolphin-2.9
ise-uiuc/Magicoder-Evol-Instruct-110K
uonlp/CulturaX
Gryphe/Sonnet3.5-Charcard-Roleplay
m-a-p/Code-Feedback
nothingiisreal/Reddit-Dirty-And-WritingPrompts
mozilla-foundation/common_voice_17_0
Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
internlm/Agent-FLAN
Locutusque/function-calling-chatml
Vezora/Tested-22k-Python-Alpaca
yahma/alpaca-cleaned
Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
nvidia/HelpSteer
HuggingFaceFW/fineweb
wikimedia/wikipedia
jondurbin/cinematika-v0.1
Anthropic/hh-rlhf
Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
AI-MO/NuminaMath-CoT
tatsu-lab/alpaca
glaiveai/glaive-function-calling-v2
codeparrot/apps
microsoft/orca-agentinstruct-1M-v1
mlabonne/orpo-dpo-mix-40k
Muennighoff/natural-instructions
argilla/distilabel-intel-orca-dpo-pairs
unalignment/toxic-dpo-v0.2
camel-ai/math
HuggingFaceTB/smoltalk
mozilla-foundation/common_voice_8_0
huggan/smithsonian_butterflies_subset
ise-uiuc/Magicoder-OSS-Instruct-75K
camel-ai/biology
facebook/belebele
anthracite-org/nopm_claude_writing_fixed
camel-ai/physics
Nopm/Opus_WritingStruct
camel-ai/chemistry
HuggingFaceFW/fineweb-edu
HuggingFaceH4/no_robots
allura-org/Celeste-1.x-data-mixture
allenai/tulu-3-sft-mixture
Gryphe/ChatGPT-4o-Writing-Prompts
grimulkan/LimaRP-augmented
nbeerbower/gutenberg2-dpo
Active filters:
trl-lib/ultrafeedback_binarized
JayHyeon/Qwen_0.5-MDPO_0.9_3e-6-3ep_0alp_0lam
Text Generation
•
Updated
•
30
JayHyeon/Qwen_0.5-MDPO_0.5_4e-6-3ep_0alp_0lam
Text Generation
•
Updated
•
28
JayHyeon/Qwen_0.5-DPO_1e-7-3ep_0alp_0lam
Text Generation
•
Updated
•
19
RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-Ultrafeedback
Updated
RLHF-And-Friends/Llama-3.2-3B-Instruct-Reward-Ultrafeedback
Updated
JayHyeon/Qwen_0.5-MDPO_0.5_6e-6-3ep_0alp_0lam
Text Generation
•
Updated
•
21
JayHyeon/Qwen_0.5-IRPO_1e-7-3ep_1alp_0lam
Text Generation
•
Updated
•
16
RLHF-And-Friends/Llama-3.1-8B-Instruct-Reward-Ultrafeedback
Updated
JayHyeon/Qwen_0.5-DPOP_1e-7-3ep_0alp_5lam
Text Generation
•
Updated
•
15
JayHyeon/QWEN_toy-DPOP_5e-5-100ep_0alp_5lam
Text Generation
•
Updated
•
5
JayHyeon/Qwen_0.5-MDPO_0.5_3e-7-3ep_0alp_0lam
Text Generation
•
Updated
•
18
JayHyeon/Qwen_0.5-DPO_3e-7-3ep_0alp_0lam
Text Generation
•
Updated
•
21
JayHyeon/Qwen_0.5-DPOP_3e-7-3ep_0alp_5lam
Text Generation
•
Updated
•
15
JayHyeon/Qwen_0.5-IRPO_3e-7-3ep_1alp_0lam
Text Generation
•
Updated
•
22
RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-Ultrafeedback-QLoRA
Updated
treasure4l/Llama3.2-Instruct-DPO
Updated
RLHF-And-Friends/RM-UltrafeedbackBinarized-Llama-3.2-3B-Instruct-Q4-LoRA8-Batch-16-Tok-1024
Updated
RLHF-And-Friends/RM-UltrafeedbackBinarized-Llama-3.2-1B-Instruct-Q4-LoRA8-Batch-16-Tok-1024
Updated
RLHF-And-Friends/RM-UltrafeedbackBinarized-Llama-3.1-8B-Instruct-Q4-LoRA8-Batch-16-Tok-1024
Updated
JayHyeon/Qwen_0.5-VDPO_5e-7-1ep_0alp_0lam
Text Generation
•
Updated
•
12
JayHyeon/Qwen_0.5-VIPO_5e-7-1ep_0alp_0lam
Text Generation
•
Updated
•
10
JayHyeon/Qwen_0.5-IPO_5e-7-1ep_0alp_0lam
Text Generation
•
Updated
•
9
JayHyeon/Qwen_0.5-VIPO_5e-7-3ep_0alp_0lam
Text Generation
•
Updated
•
14
JayHyeon/Qwen_0.5-VDPO_5e-7-3ep_0alp_0lam
Text Generation
•
Updated
•
10
JayHyeon/Qwen_0.5-IPO_5e-7-3ep_0alp_0lam
Text Generation
•
Updated
•
11
iben/Abuja-01
Updated
•
20
JayHyeon/Qwen_0.5-BDPO_5e-5-100ep_0alp_0lam
Text Generation
•
Updated
•
55
JayHyeon/Qwen_0.5-IRPO_5e-5-100ep_1alp_0lam
Text Generation
•
Updated
•
20
JayHyeon/Qwen_0.5-DPO_5e-5-100ep_0alp_0lam
Text Generation
•
Updated
•
5