PetiteTech

non-profit

Activity Feed Request to join this org

AI & ML interests

None defined yet.

ldwang

authored a paper 5 months ago

Trainable Dynamic Mask Sparse Attention

Paper • 2508.02124 • Published Aug 4 • 17

ldwang

authored a paper 6 months ago

Infinity Instruct: Scaling Instruction Selection and Synthesis to Enhance Language Models

Paper • 2506.11116 • Published Jun 9 • 4

ldwang

authored a paper 7 months ago

CCI4.0: A Bilingual Pretraining Dataset for Enhancing Reasoning in Large Language Models

Paper • 2506.07463 • Published Jun 9 • 10

ldwang

authored 3 papers about 1 year ago

CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models

Paper • 2410.18505 • Published Oct 24, 2024 • 11

Infinity-MM: Scaling Multimodal Performance with Large-Scale and High-Quality Instruction Data

Paper • 2410.18558 • Published Oct 24, 2024 • 18

Emu3: Next-Token Prediction is All You Need

Paper • 2409.18869 • Published Sep 27, 2024 • 95

ldwang

authored 2 papers over 1 year ago

AquilaMoE: Efficient Training for MoE Models with Scale-Up and Scale-Out Strategies

Paper • 2408.06567 • Published Aug 13, 2024 • 2

Aquila2 Technical Report

Paper • 2408.07410 • Published Aug 14, 2024 • 15