Penghui Qi's picture

1 8 3

Penghui Qi

QPHutu

·

QPHutu

AI & ML interests

None yet

Recent Activity

updated a collection about 1 month ago

LLM Pretraining

updated a collection about 1 month ago

LLM Pretraining

upvoted a collection 3 months ago

⚓️ Sailor Language Models

View all activity

Organizations

QPHutu's activity

updated a collection about 1 month ago

LLM Pretraining

1 item • Updated Jan 20

upvoted 5 collections 3 months ago

⚓️ Sailor Language Models

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 17 items • Updated Dec 3, 2024 • 17

💡 DICE

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28, 2024 • 9

📈 Scaling Laws with Vocabulary

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11, 2024 • 6

🧬 RegMix: Data Mixture as Regression

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26, 2024 • 8

🔱 Sailor2 Language Models

Sailing in South-East Asia with Inclusive Multilingual LLMs • 34 items • Updated about 3 hours ago • 24

authored a paper 3 months ago

Balancing Pipeline Parallelism with Vocabulary Parallelism

Paper • 2411.05288 • Published Nov 8, 2024 • 20

updated a collection 4 months ago

Pipeline Parallelism

3 items • Updated Nov 11, 2024

upvoted a paper 4 months ago

Balancing Pipeline Parallelism with Vocabulary Parallelism

Paper • 2411.05288 • Published Nov 8, 2024 • 20

liked a Space 8 months ago

Pipeline Parallellism with Controllable Memory

Calculate and visualize different scheduling strategies

authored a paper 9 months ago

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24, 2024 • 3

updated a collection 9 months ago

Pipeline Parallelism

3 items • Updated Nov 11, 2024

upvoted a paper 9 months ago

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24, 2024 • 3

commented a paper 9 months ago

2BP: 2-Stage Backpropagation

Paper • 2405.18047 • Published May 28, 2024 • 23 •

liked a Space 12 months ago

EditAnything

authored a paper about 1 year ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 24

updated a collection about 1 year ago

Pipeline Parallelism

3 items • Updated Nov 11, 2024