Is there a small (<5GB) dataset for general-purpose LLMs?

mrfakename November 17, 2023, 10:29pm 1

Hi,
Is there a tiny (<5GB) dataset for training small LLMs for general purposes?
Thanks!

Topic		Replies	Views
Train LLM Model using multiple datasets Beginners	0	778	July 28, 2023
How to fine-tune to 3 very different sized datasets (very large to very small) Intermediate	0	786	February 24, 2023
Alternatives to NanoGPT Beginners	3	576	May 22, 2024
Using LLM for Data Analytics Beginners	1	1291	June 7, 2025
Open Source LLMs: Your experience and recommendation Beginners	0	982	November 17, 2023