Edit Models filters

argilla/ultrafeedback-binarized-preferences-cleaned

Intel/orca_dpo_pairs

Open-Orca/SlimOrca-Dedup

meta-math/MetaMathQA

ise-uiuc/Magicoder-Evol-Instruct-110K

ise-uiuc/Magicoder-OSS-Instruct-75K

jondurbin/airoboros-2.2.1

teknium/openhermes

HuggingFaceH4/capybara

HuggingFaceH4/ultrachat_200k

alexredna/oasst2_dpo_pairs

allenai/tulu-v2-sft-mixture

cerebras/SlimPajama-627B

cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split

hkust-nlp/deita-10k-v0

LDJnr/Pure-Dove

LDJnr/Verified-Camel

jondurbin/truthy-dpo-v0.1

migtissera/Synthia-v1.3

wenbopan/Chinese-dpo-pairs

allenai/tulu-v2-sft-mixture-olmo-4096

argilla/distilabel-capybara-dpo-7k-binarized

Anthropic/hh-rlhf

berkeley-nest/Nectar

lmsys/chatbot_arena_conversations

openai/summarize_from_feedback

openai/webgpt_comparisons

openbmb/UltraFeedback

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

HuggingFaceH4/ultrafeedback_binarized

teknium/OpenHermes-2.5

fka/awesome-chatgpt-prompts

microsoft/orca-math-word-problems-200k

cis-lmu/Glot500

m-a-p/CodeFeedback-Filtered-Instruction

Open-Orca/OpenOrca

allenai/MADLAD-400

cognitivecomputations/dolphin-coder

bigcode/starcoderdata

jondurbin/gutenberg-dpo-v0.1

Open-Orca/SlimOrca

cognitivecomputations/samantha-data

oscar-corpus/OSCAR-2109

kiranpantha/dataset-for-peft-cv-nepds

TIGER-Lab/MathInstruct

garage-bAInd/Open-Platypus

legacy-datasets/wikipedia

databricks/databricks-dolly-15k

mozilla-foundation/common_voice_13_0

OpenAssistant/oasst1

anthracite-org/kalo-opus-instruct-22k-no-refusal

EleutherAI/pile

lmsys/lmsys-chat-1m

tiiuae/falcon-refinedweb

allenai/ultrafeedback_binarized_cleaned

jondurbin/airoboros-3.2

AI-MO/NuminaMath-CoT

AI-MO/NuminaMath-TIR

facebook/voxpopuli

m-a-p/Code-Feedback

open-r1/OpenR1-Math-220k

togethercomputer/RedPajama-Data-1T

mozilla-foundation/common_voice_17_0

Gryphe/Sonnet3.5-Charcard-Roleplay

cognitivecomputations/Dolphin-2.9

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

nothingiisreal/Reddit-Dirty-And-WritingPrompts

HuggingFaceFW/fineweb

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

internlm/Agent-FLAN

Locutusque/function-calling-chatml

HuggingFaceTB/smoltalk

microsoft/orca-agentinstruct-1M-v1

argilla/dpo-mix-7k

wikimedia/wikipedia

Vezora/Tested-22k-Python-Alpaca

yahma/alpaca-cleaned

allenai/tulu-3-sft-mixture

nvidia/HelpSteer

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

jondurbin/cinematika-v0.1

tatsu-lab/alpaca

codeparrot/apps

NousResearch/hermes-function-calling-v1

glaiveai/glaive-function-calling-v2

anthracite-org/nopm_claude_writing_fixed

OpenCoder-LLM/opc-sft-stage1

mlabonne/orpo-dpo-mix-40k

HuggingFaceFW/fineweb-edu

Muennighoff/natural-instructions

nbeerbower/gutenberg2-dpo

unalignment/toxic-dpo-v0.2

mozilla-foundation/common_voice_8_0

argilla/distilabel-intel-orca-dpo-pairs

Nopm/Opus_WritingStruct

OpenCoder-LLM/opc-sft-stage2

huggan/smithsonian_butterflies_subset

camel-ai/biology

camel-ai/physics

facebook/belebele

allura-org/Celeste-1.x-data-mixture

camel-ai/chemistry

Gryphe/ChatGPT-4o-Writing-Prompts

HuggingFaceH4/no_robots

nvidia/HelpSteer2

open-thoughts/OpenThoughts-114k

kingbri/PIPPA-shareGPT

grimulkan/LimaRP-augmented

FreedomIntelligence/medical-o1-reasoning-SFT

Models

126

Full-text search

Active filters: argilla/ultrafeedback-binarized-preferences-cleaned

vikarti-anatra/Faro-Yi-9B-DPO-8bpw-exl2

Text Generation • Updated May 25, 2024 • 4 • 1

bartowski/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated May 24, 2024 • 478 • 4

vikarti-anatra/Faro-Yi-9B-DPO-gguf

Text Generation • Updated May 25, 2024 • 34 • 1

ggalmeida0/Faro-Yi-9B-DPO-Q8_0-GGUF

Text Generation • Updated May 26, 2024 • 6

StefanKrsteski/Phi-3-mini-4k-instruct-DPO-EPFL

Updated Jun 4, 2024 • 5

AliE02/NaturalLanguagePioneersDPO

Text Generation • Updated May 30, 2024 • 5

allenai/llama-3-tulu-2-dpo-70b

Text Generation • Updated Aug 5, 2024 • 6

allenai/llama-3-tulu-2-dpo-8b

Text Generation • Updated Aug 9, 2024 • 15 • 1

MoxoffSrL/Moxoff-Phi3Mini-KTO

Text Generation • Updated Jun 27, 2024 • 4.31k

MoxoffSrL/Moxoff-Phi3Mini-DPO

Text Generation • Updated Jun 27, 2024 • 4.34k

MoxoffSrL/Moxoff-Phi3Mini-ORPO

Text Generation • Updated Jun 27, 2024 • 4.28k

MoxoffSrL/Moxoff-Phi3Mini-PPO

Text Generation • Updated Jun 27, 2024 • 4.28k

hamishivi/OLMo-1B-0724-Instruct-hf

Text Generation • Updated Jul 17, 2024 • 255

mradermacher/llama-3-tulu-2-dpo-70b-GGUF

Updated Jul 19, 2024 • 21

mradermacher/llama-3-tulu-2-dpo-8b-GGUF

Updated Jul 20, 2024 • 56

mradermacher/llama-3-tulu-2-dpo-70b-i1-GGUF

Updated Aug 2, 2024 • 70

mradermacher/llama-3-tulu-2-dpo-8b-i1-GGUF

Updated Aug 2, 2024 • 62

allenai/llama-3.1-tulu-2-dpo-70b

Updated Aug 15, 2024 • 9

allenai/llama-3.1-tulu-2-dpo-8b

Updated Aug 15, 2024 • 27

depurator/llama-3.1-tulu-2-dpo-8b-Q4_K_M-GGUF

Updated Aug 28, 2024 • 3

AINovice2005/ElEmperador

Text Generation • Updated Oct 16, 2024 • 17

mradermacher/ElEmperador-GGUF

Updated Oct 14, 2024 • 34

miulab/llama2-7b-ultrafeedback-rm

Text Classification • Updated Oct 3, 2024 • 8

mradermacher/DPO_mistral_v01_7b_ultra_0131_1k_1epoch-GGUF

Updated Nov 7, 2024 • 25

mradermacher/DPO_mistral_v01_7b_ultra_0130_1k-GGUF

Updated Nov 7, 2024 • 54

tensorblock/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated Nov 16, 2024 • 54

tensorblock/Moxoff-Phi3Mini-PPO-GGUF

Updated Nov 16, 2024 • 61

tensorblock/Moxoff-Phi3Mini-ORPO-GGUF

Updated Nov 16, 2024 • 64

tensorblock/Moxoff-Phi3Mini-KTO-GGUF

Updated Nov 16, 2024 • 63

mradermacher/dolphin-2.6-mistral-7b-dpo-GGUF

Updated Nov 15, 2024 • 69