Is there a small (<5GB) dataset for general-purpose LLMs?

mrfakename November 17, 2023, 10:29pm 1

Hi,
Is there a tiny (<5GB) dataset for training small LLMs for general purposes?
Thanks!

Topic		Replies	Views
Train LLM Model using multiple datasets Beginners	0	756	July 28, 2023
How to fine-tune to 3 very different sized datasets (very large to very small) Intermediate	0	759	February 24, 2023
Alternatives to NanoGPT Beginners	3	513	May 22, 2024
Open Source LLMs: Your experience and recommendation Beginners	0	960	November 17, 2023
Request for Further Information on Datasets Beginners	0	278	November 26, 2020