MiniPLM Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models MiniLLM/MiniPLM-Qwen-200M Text Generation • 0.2B • Updated Oct 27, 2024 • 60 • 9 MiniLLM/MiniPLM-Qwen-500M Text Generation • 0.5B • Updated Mar 25 • 23 • 7 MiniLLM/MiniPLM-Qwen-1.2B Text Generation • 1B • Updated Mar 25 • 57 • 4 MiniLLM/MiniPLM-Mamba-130M Text Generation • 0.1B • Updated Mar 25 • 12 • 3
MiniLLM MiniLLM Models MiniLLM/MiniLLM-gpt2-120M Text Generation • 0.1B • Updated Sep 26, 2024 • 88 MiniLLM/MiniLLM-gpt2-340M Text Generation • Updated Apr 11 • 84 • 4 MiniLLM/MiniLLM-gpt2-760M Text Generation • Updated Sep 26, 2024 • 58 MiniLLM/MiniLLM-OPT-1.3B Text Generation • Updated Sep 26, 2024 • 66 • 1
MiniPLM Pre-trained models in MiniPLM: Knowledge Distillation for Pre-Training Language Models MiniLLM/MiniPLM-Qwen-200M Text Generation • 0.2B • Updated Oct 27, 2024 • 60 • 9 MiniLLM/MiniPLM-Qwen-500M Text Generation • 0.5B • Updated Mar 25 • 23 • 7 MiniLLM/MiniPLM-Qwen-1.2B Text Generation • 1B • Updated Mar 25 • 57 • 4 MiniLLM/MiniPLM-Mamba-130M Text Generation • 0.1B • Updated Mar 25 • 12 • 3
MiniLLM MiniLLM Models MiniLLM/MiniLLM-gpt2-120M Text Generation • 0.1B • Updated Sep 26, 2024 • 88 MiniLLM/MiniLLM-gpt2-340M Text Generation • Updated Apr 11 • 84 • 4 MiniLLM/MiniLLM-gpt2-760M Text Generation • Updated Sep 26, 2024 • 58 MiniLLM/MiniLLM-OPT-1.3B Text Generation • Updated Sep 26, 2024 • 66 • 1
