Pre-training 11M parameter models on 29k, 5M, 10M, 20M, & 205M rows of Dolma dataset using pico-lm
Thomas Nguyen
ThomasTheMaker
AI & ML interests
Building the world's fastest CPU LLM inference layer
Recent Activity
updated
a model
about 14 hours ago
ThomasTheMaker/ReplaceMe-Experiments
published
a model
about 14 hours ago
ThomasTheMaker/ReplaceMe-Experiments
updated
a collection
about 15 hours ago
Pico LM
Organizations
None yet
models
61
ThomasTheMaker/ReplaceMe-Experiments
Updated
ThomasTheMaker/pico-decoder-tiny-experiments
Updated
ThomasTheMaker/tiny-Dolma205M
0.0B
•
Updated
•
7
ThomasTheMaker/tiny-dolma20M
0.0B
•
Updated
•
11
ThomasTheMaker/pico-decoder-tiny-dolma10M-v1
Updated
ThomasTheMaker/tiny-dolma10M
0.0B
•
Updated
•
5
ThomasTheMaker/fritzing-1.0.4-free
Updated
ThomasTheMaker/pico-decoder-tiny
0.0B
•
Updated
•
27
ThomasTheMaker/TinyDeepseek-fineweb-edu-30parquet-processed
Updated
ThomasTheMaker/TinyDeepseek-fineweb-edu-10gb-5parquet-processed
Updated
datasets
16
ThomasTheMaker/pretokenized_wiki_en
Viewer
•
Updated
•
448k
•
240
ThomasTheMaker/pretokenized-dolma-100M
Updated
•
16
ThomasTheMaker/pretokenized-dolma-20M
Viewer
•
Updated
•
22.6M
•
378
ThomasTheMaker/pretokenized-dolma-10M
Viewer
•
Updated
•
11.3M
•
287
ThomasTheMaker/pretokenized-dolma-5M
Viewer
•
Updated
•
5.65M
•
262
ThomasTheMaker/fineweb-edu-6parquet-processed
Updated
•
22
ThomasTheMaker/fineweb-edu-10gb-5parquet-processed
Updated
•
12
ThomasTheMaker/Luna-data-factory
Updated
•
100
ThomasTheMaker/hermes-toolace-ori
Viewer
•
Updated
•
11.3k
•
3
ThomasTheMaker/Lawyer-Instruct-Ori
Viewer
•
Updated
•
9.24k
•
8