allenai/MADLAD-400
Updated
•
37.4k
•
152
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 23.8k • 42 -
allenai/dolma
Updated • 1.64k • 962 -
allenai/peS2o
Updated • 2.53k • 184 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 7.27k • 392 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 2.12k • 56 -
togethercomputer/RedPajama-Data-V2
Updated • 6.21k • 385 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 15.3k • 878 -
togethercomputer/RedPajama-Data-1T
Viewer • Updated • 1.73M • 2.18k • 1.11k -
cerebras/SlimPajama-627B
Preview • Updated • 44.8k • 509 -
Tele-AI/TeleChat-PTD
Updated • 995 • 172 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 13.2k • 320 -
GAIR/MathPile
Preview • Updated • 293 • 191 -
EleutherAI/proof-pile-2
Updated • 8.33k • 209 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 1.15k -
meta-math/MetaMathQA
Viewer • Updated • 395k • 9.97k • 420 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 7.89k • 373 -
bigcode/the-stack
Viewer • Updated • 546M • 25.3k • 889 -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 57 • 92 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 8.62k • 554 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 7.31k • 196 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 57.8k • 647