babylm-seqlen/train_100M_256
Viewer
•
Updated
•
639k
•
5
Double Shuffled Data
Data shuffled at both the document-level, and again at the tokenized level
-
-
babylm-seqlen/train_100M_1024
Viewer • Updated • 160k • 8 -
babylm-seqlen/train_100M_16384
Viewer • Updated • 9.86k • 8 -
babylm-seqlen/train_100M_4096
Viewer • Updated • 39.8k • 9 -
babylm-seqlen/train_100M_512
Viewer • Updated • 319k -
babylm-seqlen/train_100M_8192
Viewer • Updated • 19.8k • 4 -
babylm-seqlen/train_100M_2048
Viewer • Updated • 79.8k • 3 -
babylm-seqlen/train_100M_128
Viewer • Updated • 1.28M • 1 -
babylm-seqlen/train_100M_64
Viewer • Updated • 2.56M • 1