Zyphra/Zyda-2
Preview
•
Updated
•
31.7k
•
83
Interesting Pre-Training Datasets
Note Look at the preprocessing code: https://github.com/Zyphra/Zyda_processing
-
HuggingFaceTB/dclm-edu
Viewer • Updated • 1B • 6.95k • 27 -
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.5B • 81.7k • 736 -
HuggingFaceTB/stack-edu
Viewer • Updated • 167M • 1.11k • 46 -
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 5.07k • 330 -
bigcode/the-stack
Viewer • Updated • 546M • 9.63k • 842 -
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 3.42k • 402 -
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 14.3k • 368 -
mlfoundations/dclm-baseline-1.0
Preview • Updated • 72.5k • 231