Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper
•
2406.14491
•
Published
•
91
Instruction Pre-Training
-
-
85
Instruction Synthesizer
🐠Generate instruction-response pairs from text
-
instruction-pretrain/InstructLM-1.3B
Text Generation • Updated • 142 • 42 -
instruction-pretrain/InstructLM-500M
Text Generation • Updated • 274 • 34 -
instruction-pretrain/instruction-synthesizer
Text Generation • Updated • 268 • 78 -
instruction-pretrain/medicine-Llama3-8B
Text Generation • Updated • 271 • 37 -
instruction-pretrain/finance-Llama3-8B
Text Generation • Updated • 1.2k • 63 -
instruction-pretrain/ft-instruction-synthesizer-collection
Viewer • Updated • 249k • 500 • 62