Xiaosen Zheng's picture

Xiaosen Zheng

xszheng2020

·

AI & ML interests

Data-Centric AI and AI Safety.

Recent Activity

updated a dataset 3 days ago

xszheng2020/s1K_tokenized_llama

published a dataset 3 days ago

xszheng2020/s1K_tokenized_llama

liked a dataset 7 days ago

simplescaling/data_ablation_full59K

View all activity

Organizations

xszheng2020's activity

upvoted a paper 7 days ago

START: Self-taught Reasoner with Tools

Paper • 2503.04625 • Published 7 days ago • 83

upvoted a collection 10 days ago

OLMo 2 Preview Post-trained Models

These model's tokenizer did not use HF's fast tokenizer, resulting in variations in how pre-tokenization was applied. Resolved in latest versions. • 6 items • Updated about 6 hours ago • 3

upvoted a paper about 1 month ago

SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Paper • 2502.02737 • Published Feb 4 • 203

upvoted an article about 1 month ago

Article

Open-R1: Update #1

By

and 7 others •

Feb 2

• 295

upvoted a collection about 2 months ago

DeepSeek-R1

8 items • Updated Jan 21 • 571

upvoted an article 2 months ago

Article

Fine-tune ModernBERT for text classification using synthetic data

By

•

Dec 30, 2024

• 32

upvoted 2 collections 3 months ago

NeMo Curator - Classifier Models

Classifier models that can be used in NeMo Curator for labelling/filtering datasets. • 11 items • Updated 27 days ago • 16

FastText Model for Pretraining Data Curation

5 items • Updated 15 days ago • 2

upvoted a paper 3 months ago

OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain

Paper • 2412.13018 • Published Dec 17, 2024 • 41

upvoted 2 collections 3 months ago

🔱 Sailor2 Language Models

Sailing in South-East Asia with Inclusive Multilingual LLMs • 34 items • Updated 18 days ago • 26

DCLM Pools

Raw pools for use in DCLM competition • 5 items • Updated Jul 17, 2024 • 1

upvoted a paper 4 months ago

Sample-Efficient Alignment for LLMs

Paper • 2411.01493 • Published Nov 3, 2024 • 12

upvoted a paper 5 months ago

Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing

Paper • 2406.08464 • Published Jun 12, 2024 • 67

upvoted a collection 5 months ago

MagpieLM

Aligning LMs with Fully Open Recipe + Synthetic Data Generated from Open-Source LMs. • 9 items • Updated Jan 13 • 16

upvoted a paper 5 months ago

Unleashing Reasoning Capability of LLMs via Scalable Question Synthesis from Scratch

Paper • 2410.18693 • Published Oct 24, 2024 • 42

upvoted 3 collections 5 months ago

ScaleQuest

We introduce ScaleQuest, a scalable and novel data synthesis method. Project Page: https://scalequest.github.io/ • 9 items • Updated Jan 7 • 6

C4AI Aya Expanse

Aya Expanse is an open-weight research release of a model with highly advanced multilingual capabilities. • 4 items • Updated 11 days ago • 38

BGE

23 items • Updated 29 days ago • 97

upvoted an article 5 months ago

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16, 2024

• 332

upvoted a paper 5 months ago

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Paper • 2401.16380 • Published Jan 29, 2024 • 49