LLM Training Datasets

sugatoray 's Collections

Papers + RL/Reasoning

Marimo

RLMs (Reasoning Language Models)

Books And Notes

Reasoning Datasets

SmolAgents Tools (Spaces)

Document AI

Bookmark::Models

LLMs

LLM Tools

AV LLMs

LLM Training Datasets

Papers

Leaderboards 🔥

Papers-MoE

Papers-LLMEval

LLM LLAMA3

Papers-Fundamentals

TFM: TimeSeries Foundation Models

Papers-Benchmarks

LLMs-EmbeddingModels

LLMs + Mamba

LLM + Datasets : Finance

updated 22 days ago

A collection of datasets for training LLMs.

Upvote

HuggingFaceTB/cosmopedia

Viewer • Updated Aug 12, 2024 • 31.1M • 22.3k • 635
fka/awesome-chatgpt-prompts

Viewer • Updated Jan 6 • 203 • 41.3k • 8.94k
HuggingFaceTB/cosmopedia-100k

Viewer • Updated Feb 19, 2024 • 100k • 391 • 45
CohereLabs/aya_dataset

Viewer • Updated Apr 15 • 206k • 1.81k • 317
m-a-p/Code-Feedback

Viewer • Updated Feb 26, 2024 • 66.4k • 328 • 210
nvidia/OpenMathInstruct-1

Viewer • Updated Feb 16, 2024 • 6.08M • 2.26k • 234
teknium/OpenHermes-2.5

Viewer • Updated Apr 15, 2024 • 1M • 2.21k • 750
Anthropic/hh-rlhf

Viewer • Updated May 26, 2023 • 169k • 16.2k • 1.42k
Open-Orca/OpenOrca

Viewer • Updated Feb 19 • 2.94M • 10.6k • 1.44k
stingning/ultrachat

Viewer • Updated Feb 22, 2024 • 774k • 1.37k • 454
tiiuae/falcon-refinedweb

Viewer • Updated Jun 20, 2023 • 968M • 9.3k • 866
liuhaotian/LLaVA-Instruct-150K

Preview • Updated Jan 3, 2024 • 3.33k • 540
Intel/orca_dpo_pairs

Viewer • Updated Nov 29, 2023 • 12.9k • 1.96k • 312
argilla/distilabel-intel-orca-dpo-pairs

Viewer • Updated 26 days ago • 12.9k • 5.15k • 178
mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha

Viewer • Updated Mar 21, 2024 • 9.2k • 101 • 19
argilla/OpenHermes-2.5-dpo

Viewer • Updated Feb 22, 2024 • 998k • 27 • 5
argilla/dpo-mix-7k

Viewer • Updated Jul 16, 2024 • 7.5k • 438 • 171
argilla/distilabel-math-preference-dpo

Viewer • Updated Jul 16, 2024 • 2.42k • 650 • 88
argilla/OpenHermes2.5-dpo-binarized-alpha

Viewer • Updated Feb 10, 2024 • 9.79k • 16 • 63
databricks/databricks-dolly-15k

Viewer • Updated Jun 30, 2023 • 15k • 20.9k • 853
allenai/dolma

Updated Apr 17, 2024 • 773 • 936
argilla/OpenHermesPreferences

Viewer • Updated Mar 1, 2024 • 989k • 481 • 208
TrustLLM/TrustLLM-dataset

Preview • Updated Mar 20, 2024 • 32 • 11
HuggingFaceH4/ultrafeedback_binarized

Viewer • Updated Oct 16, 2024 • 187k • 31k • 302
HuggingFaceH4/ultrachat_200k

Viewer • Updated Oct 16, 2024 • 515k • 26.8k • 567
TIGER-Lab/SKGInstruct

Preview • Updated Apr 9, 2024 • 36 • 28
TIGER-Lab/SKGInstruct-skg-only

Viewer • Updated Feb 27, 2024 • 677k • 167 • 7
bigcode/the-stack-v2-train-full-ids

Viewer • Updated Jun 6, 2024 • 60.5M • 523 • 52
garage-bAInd/Open-Platypus

Viewer • Updated Jan 24, 2024 • 24.9k • 5.77k • 401
Training-Free Long-Context Scaling of Large Language Models

Paper • 2402.17463 • Published Feb 27, 2024 • 25
allenai/paloma

Viewer • Updated Jun 6, 2024 • 309k • 1.56k • 39
Cohere/BinaryVectorDB

Updated Mar 26, 2024 • 44 • 7
gretelai/synthetic_text_to_sql

Viewer • Updated May 10, 2024 • 106k • 3.51k • 588
mlabonne/chatml_dpo_pairs

Viewer • Updated Apr 11, 2024 • 12.9k • 87 • 54
argilla/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Jul 16, 2024 • 7.56k • 932 • 182
mlabonne/orpo-dpo-mix-40k

Viewer • Updated Oct 17, 2024 • 44.2k • 743 • 289
unalignment/toxic-dpo-v0.2

Viewer • Updated Jan 9, 2024 • 541 • 307 • 134
efederici/alpaca-vs-alpaca-orpo-dpo

Viewer • Updated May 15, 2024 • 49.2k • 51 • 7
HuggingFaceFW/fineweb

Viewer • Updated Jul 11 • 52.5B • 242k • 2.34k
Anthropic/persuasion

Viewer • Updated Apr 9, 2024 • 3.94k • 265 • 194
allenai/WildChat-1M

Viewer • Updated Oct 17, 2024 • 838k • 4.96k • 372
allenai/WildChat

Viewer • Updated 21 days ago • 529k • 1.78k • 162
bigcode/self-oss-instruct-sc2-exec-filter-50k

Viewer • Updated Nov 4, 2024 • 50.7k • 239 • 101
HuggingFaceFW/fineweb-edu

Viewer • Updated Jul 11 • 3.5B • 116k • 741
HuggingFaceFW/fineweb-edu-score-2

Viewer • Updated Jul 11 • 13.9B • 6.43k • 78
NousResearch/CharacterCodex

Viewer • Updated Jun 17, 2024 • 15.9k • 413 • 225
bigcode/bigcodebench

Viewer • Updated Apr 30 • 5.7k • 27.3k • 68
dreamproit/bill_summary_us

Viewer • Updated Oct 17, 2023 • 125k • 87 • 13
HuggingFaceM4/Docmatix

Viewer • Updated Aug 26, 2024 • 2.55M • 9.59k • 288
AI-MO/NuminaMath-CoT

Viewer • Updated Nov 25, 2024 • 860k • 4.92k • 489
gouravsinha/finance-NER

Text Generation • Updated May 11, 2023 • 17 • 6
sujet-ai/Sujet-Finance-Instruct-177k

Viewer • Updated Apr 5, 2024 • 178k • 422 • 82
rajpurkar/squad

Viewer • Updated Mar 4, 2024 • 98.2k • 57.7k • 325
pminervini/HaluEval

Viewer • Updated Dec 7, 2023 • 64.5k • 1.52k • 17
argilla/magpie-ultra-v0.1

Viewer • Updated Nov 26, 2024 • 50k • 607 • 221
open-llm-leaderboard/requests

Preview • Updated Mar 17 • 37.8k • 12
open-llm-leaderboard/results

Preview • Updated Mar 15 • 2.62k • 15
gabrielmbmb/distilabel-reflection-tuning

Viewer • Updated Sep 6, 2024 • 5 • 37 • 55
Running

81

81

Semantic Hugging Face Hub Search

🔎

Find datasets and models using semantic search
open-llm-leaderboard/AGI-0__Artificium-llama3.1-8B-001-details

Viewer • Updated Feb 13 • 43.2k • 15 • 1
argilla/FinePersonas-v0.1

Viewer • Updated Dec 11, 2024 • 42.1M • 9.47k • 405
proj-persona/PersonaHub

Viewer • Updated Mar 4 • 375k • 15.1k • 628
thesven/Reflective-MAGLLAMA-v0.1

Viewer • Updated Sep 18, 2024 • 10.2k • 56 • 47
google/frames-benchmark

Viewer • Updated Oct 15, 2024 • 824 • 2.45k • 223
TableFormer: Table Structure Understanding with Transformers

Paper • 2203.01017 • Published Mar 2, 2022
migtissera/Synthia-v1.5-I

Viewer • Updated Sep 30, 2024 • 20.7k • 45 • 45
cais/mmlu

Viewer • Updated Mar 8, 2024 • 231k • 305k • 530
LLM360/TxT360

Updated May 26 • 15.6k • 238
arcee-ai/EvolKit-20k

Viewer • Updated Sep 10, 2024 • 20k • 105 • 58
migtissera/Synthia-Coder-v1.5-I

Viewer • Updated Oct 14, 2024 • 23.6k • 8 • 32
mlabonne/open-perfectblend

Viewer • Updated Jan 15 • 1.42M • 332 • 51
KingNish/reasoning-base-20k

Viewer • Updated May 15 • 19.9k • 260 • 225
abhinand/MedEmbed-base-v0.1

0.1B • Updated Oct 21, 2024 • 49k • 14
Running

69

69

Vectorsearch Hub Datasets

🔥

Add vectors to Hub datasets and do in memory vector search.
microsoft/orca-agentinstruct-1M-v1

Viewer • Updated Nov 1, 2024 • 1.05M • 2.26k • 450
HuggingFaceTB/smoltalk

Viewer • Updated Feb 10 • 2.2M • 5k • 358
OpenGVLab/MMPR

Preview • Updated Apr 11 • 55 • 49
MaziyarPanahi/calme-legalkit-v0.2

Viewer • Updated Oct 31, 2024 • 53k • 41 • 9
megrisdal/llms-txt

Viewer • Updated about 12 hours ago • 77 • 169 • 13
meta-llama/Llama-3.3-70B-Instruct-evals

Viewer • Updated Dec 6, 2024 • 41.3k • 608 • 41
HuggingFaceFW/fineweb-2

Viewer • Updated Jun 27 • 5.02B • 39.8k • 625
zai-org/LongBench

Updated Dec 18, 2024 • 47.3k • 152
opendatalab/OmniDocBench

Viewer • Updated Feb 11 • 984 • 5.28k • 34
fluently-sets/reasoning-1-1k

Viewer • Updated Dec 21, 2024 • 1.15k • 34 • 25
Sleeping

9

9

Transformers Pipeline Playground

🐇

Search, load and play with transformer pipelines
m-ric/agents_medium_benchmark_2

Viewer • Updated Dec 27, 2024 • 142 • 289 • 11
choosealicense/licenses

Updated Apr 17, 2024 • 2.3k • 31
mlabonne/FineTome-100k

Viewer • Updated Jul 29, 2024 • 100k • 13.7k • 231
openbmb/RLAIF-V-Dataset

Viewer • Updated Mar 4 • 74.8k • 1.3k • 190
NovaSky-AI/Sky-T1_data_17k

Viewer • Updated Jan 14 • 16.4k • 187 • 186
openai/gsm8k

Viewer • Updated Jan 4, 2024 • 17.6k • 401k • 849
generaleoley/manim-codegen

Viewer • Updated Feb 18, 2024 • 1.62k • 146 • 8
allenai/tulu-3-sft-mixture

Viewer • Updated Dec 2, 2024 • 939k • 18k • 164
TIGER-Lab/WebInstruct-CFT

Viewer • Updated Feb 2 • 654k • 179 • 54
penfever/rewild-sft

Viewer • Updated Feb 1 • 359k • 129 • 2
teleren/ui-navigation-corpus

Viewer • Updated Feb 3 • 1.03M • 187 • 15
bebop404/llama_training

Viewer • Updated Mar 19 • 29.6k • 14 • 1
wikimedia/wikipedia

Viewer • Updated Jan 9, 2024 • 61.6M • 46.9k • 909
ARTPARK-IISc/Vaani

Updated about 11 hours ago • 4.61k • 63
open-r1/OpenR1-Math-220k

Viewer • Updated Feb 18 • 450k • 14.7k • 642
simplescaling/s1K-1.1

Viewer • Updated Feb 27 • 1k • 4.1k • 133
agents-course/certificates

Preview • Updated about 2 hours ago • 16k • 60
dvilasuero/XSTest-R1

Viewer • Updated Feb 20 • 100 • 20 • 1
open-thoughts/OpenThoughts-114k

Viewer • Updated 2 days ago • 228k • 31k • 750
facebook/natural_reasoning

Viewer • Updated Feb 21 • 1.15M • 1.56k • 517
FreedomIntelligence/medical-o1-reasoning-SFT

Viewer • Updated Apr 22 • 90.1k • 20.4k • 862
dvilasuero/natural-science-reasoning

Viewer • Updated Mar 2 • 100 • 70 • 38
dvilasuero/jailbreak-classification-gemma

Viewer • Updated Mar 19 • 100 • 142 • 2
kyutai/Babillage

Viewer • Updated Mar 21 • 465k • 368 • 9
agentica-org/DeepCoder-Preview-Dataset

Viewer • Updated Apr 9 • 25k • 1.97k • 82
nvidia/Nemotron-CrossThink

Preview • Updated May 1 • 317 • 110
One-RL-to-See-Them-All/Orsta-Data-47k

Updated Jun 4 • 398 • 15
open-r1/Mixture-of-Thoughts

Viewer • Updated May 26 • 699k • 5.77k • 268
Running

205

205

Visualize Dataset (v2.0+ latest dataset format)

💻

Visualize LeRobot Datasets
PleIAs/common_corpus

Viewer • Updated Jun 10 • 470M • 14.7k • 305
rajpurkarlab/ReXVQA

Updated Jun 10 • 60 • 12
ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding

Paper • 2506.04353 • Published Jun 4 • 1
institutional/institutional-books-1.0

Viewer • Updated Jun 16 • 983k • 5.92k • 250
Data Efficacy for Language Model Training

Paper • 2506.21545 • Published Jun 26 • 11
giskardai/realperformance

Viewer • Updated Jul 17 • 1.27k • 163 • 3
jxm/gpt-oss20b-samples

Viewer • Updated 25 days ago • 8.96M • 3.83k • 85

Upvote

Collection guide
Browse collections

LLM Training Datasets

Semantic Hugging Face Hub Search

Vectorsearch Hub Datasets

Transformers Pipeline Playground

Visualize Dataset (v2.0+ latest dataset format)