Hey everyone, I’m currently looking for a very small LLM that cannot exceed 1.5GB in size. The goal is for it to handle simple Q&A tasks (nothing fact-based or overly complex, just basic interpretation of input). Additionally, the model needs to understand basic writing mistakes (typos, grammar iss…

Looking for a Tiny LLM (max 1.5GB) – Need Advice

John6666 September 29, 2024, 1:21am 6

thank you to open issue.

Topic		Replies	Views
Advice on LLMs that can be used directly in Python Beginners	1	191	November 15, 2024
How to find models that work on low memory/CPU edge devices Models	3	751	October 17, 2024
Is there a small (<5GB) dataset for general-purpose LLMs? Beginners	0	373	November 17, 2023
Resource required to fine tune a large model? Beginners	0	380	November 12, 2022
Which model is best for code generation under [b]10GB[/b] Beginners	1	331	February 24, 2025