PowerInfer

community

AI & ML interests

We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.

Recent Activity

yixinsong published a model 18 days ago

PowerInfer/OPT-7B-predictor

yixinsong updated a model about 2 months ago

PowerInfer/SmallThinker-3B-Preview

yixinsong new activity about 2 months ago

PowerInfer/SmallThinker-3B-Preview:Eval script

View all activity

models 24

PowerInfer/SmallThinker-3B-Preview

Text Generation • Updated Jan 16 • 122k • • 390

PowerInfer/SparseQwen2-7B

Updated Dec 25, 2024 • 26 • 3

PowerInfer/TurboSparse-Mistral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 169 • 20

PowerInfer/TurboSparse-Mixtral

Feature Extraction • Updated Jun 14, 2024 • 46 • 35

PowerInfer/TurboSparse-Mixtral-Instruct

Feature Extraction • Updated Jun 14, 2024 • 21 • 28

PowerInfer/Bamboo-base-v0_1

Feature Extraction • Updated Jun 7, 2024 • 53 • 22

PowerInfer/Bamboo-DPO-v0_1

Feature Extraction • Updated Jun 7, 2024 • 20 • 7

PowerInfer/OPT-7B-predictor

Updated Apr 10, 2024 • 3

PowerInfer/Bamboo-DPO-v0.1-predictor

Updated Mar 28, 2024

PowerInfer/Bamboo-DPO-v0.1-gguf

Updated Mar 28, 2024 • 101 • 7

datasets 2

PowerInfer/LONGCOT-Refine-500K

Viewer • Updated Jan 2 • 522k • 199 • 45

PowerInfer/QWQ-LONGCOT-500K

Viewer • Updated Dec 26, 2024 • 286k • 401 • 120