Xinyi Wan's picture

3 6 5

Xinyi Wan

ufotalent

·

AI & ML interests

ML Sys

Recent Activity

upvoted a paper 12 days ago

PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

commented on a paper 12 days ago

PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

liked a Space 14 days ago

nanotron/ultrascale-playbook

View all activity

Organizations

ufotalent's activity

upvoted a paper 12 days ago

PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

Paper • 2503.01328 • Published 14 days ago • 14

commented a paper 12 days ago

PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization

Paper • 2503.01328 • Published 14 days ago • 14 •

liked a Space 14 days ago

The Ultra-Scale Playbook

The ultimate guide to training LLM on large GPU Clusters

published an article 17 days ago

Article

双流并行(DualPipe) 没有双流会更好

By

•

17 days ago

• 4

upvoted an article 17 days ago

Article

DualPipe could be better without the Dual

By

•

17 days ago

• 16

published an article 17 days ago

Article

DualPipe could be better without the Dual

By

•

17 days ago

• 16

upvoted a collection 3 months ago

🔱 Sailor2 Language Models

Sailing in South-East Asia with Inclusive Multilingual LLMs • 34 items • Updated 21 days ago • 26

upvoted a paper 4 months ago

Balancing Pipeline Parallelism with Vocabulary Parallelism

Paper • 2411.05288 • Published Nov 8, 2024 • 20

commented a paper 4 months ago

Balancing Pipeline Parallelism with Vocabulary Parallelism

Paper • 2411.05288 • Published Nov 8, 2024 • 20 •

updated a Space 7 months ago

Pipeline Parallellism with Controllable Memory

Calculate and visualize different scheduling strategies

liked a Space 7 months ago

Pipeline Parallellism with Controllable Memory

Calculate and visualize different scheduling strategies

updated a Space 9 months ago

Zero Bubble Pipeline Parallellism

Optimize pipeline schedules for efficient computing

upvoted a paper 9 months ago

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24, 2024 • 3

authored a paper 9 months ago

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24, 2024 • 3

liked a Space about 1 year ago

Sailor2 20B Chat

Chat with Sailor2, a multilingual AI assistant

liked a model about 1 year ago

sail/Sailor-7B

Text Generation • Updated Dec 21, 2024 • 341 • 28

commented a paper about 1 year ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 24 •

upvoted a paper about 1 year ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 24

liked a Space over 1 year ago

Zero Bubble Pipeline Parallellism

Optimize pipeline schedules for efficient computing

updated a dataset over 1 year ago

ufotalent/zero_bubble_sample_dataset

Updated Nov 20, 2023 • 85 • 2