PowerInfer/OPT-7B-predictor
Updated
•
3
PowerInfer
community
AI & ML interests
We are committed to advancing the field of AGI by pushing the boundaries of local LLM inference efficiency.
Recent Activity
View all activity
PowerInfer's activity
yixinsong
published
a
model
19 days ago
yixinsong
updated
a
model
about 2 months ago
Eval script
4
#9 opened about 2 months ago
by
rawsh
About the training details
5
#5 opened 2 months ago
by
hiyouga
How to Pair with Larger Models
4
#7 opened 2 months ago
by
windkkk
Prompt/token adjust to stop "Overthinking" in unnescissary cases
2
#6 opened 2 months ago
by
fuzzy-mittenz
example use colab?
8
#3 opened 2 months ago
by
NickyNicky
Update README.md
#4 opened 2 months ago
by
AISafety
Training: Second Phase
6
#2 opened 2 months ago
by
tugstugi
[bot] Conversion to Parquet
#1 opened 3 months ago
by
parquet-converter
[bot] Conversion to Parquet
#1 opened 2 months ago
by
parquet-converter
Librarian Bot: Add language metadata for dataset
#2 opened 2 months ago
by
librarian-bot
Raincleared
authored
a
paper
4 months ago
Raincleared
authored
a
paper
6 months ago
bobozi
authored
a
paper
8 months ago
yixinsong
authored
3
papers
9 months ago
Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
Paper
•
2406.05955
•
Published
•
27
ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
Paper
•
2402.03804
•
Published
•
2
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
Paper
•
2406.06282
•
Published
•
38
yzmizeyu
authored
2
papers
9 months ago