Predictable Scale: Part I -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining
Paper
•
2503.04715
•
Published
•
1
wen
zhengwenzhen
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 19 hours ago
Predictable Scale: Part I -- Optimal Hyperparameter Scaling Law in Large
Language Model Pretraining
liked
a Space
4 days ago
nanotron/ultrascale-playbook
upvoted
an
article
6 months ago
Recreating o1 at Home with Role-Play LLMs
Organizations
zhengwenzhen's activity
upvoted
a
paper
about 19 hours ago
upvoted
an
article
6 months ago
Article
Recreating o1 at Home with Role-Play LLMs
By
•
•
23