babylm-seqlen/train_100M_256
Viewer
•
Updated
•
639k
•
6
Double Shuffled Data
Data shuffled at both the document-level, and again at the tokenized level
-
-
babylm-seqlen/train_100M_1024
Viewer • Updated • 160k • 3 -
babylm-seqlen/train_100M_16384
Viewer • Updated • 9.86k • 2 -
babylm-seqlen/train_100M_4096
Viewer • Updated • 39.8k • 3 -
babylm-seqlen/train_100M_512
Viewer • Updated • 319k • 1 -
babylm-seqlen/train_100M_8192
Viewer • Updated • 19.8k • 1 -
babylm-seqlen/train_100M_2048
Viewer • Updated • 79.8k • 3 -
babylm-seqlen/train_100M_128
Viewer • Updated • 1.28M • 2 -
babylm-seqlen/train_100M_64
Viewer • Updated • 2.56M • 3