Are there any decoder-only llama, mistral, gemma or otherwise that has < 1B parameters? Any recommendations, esp. ones that are good at multilingual tasks?

Small Decoder-only model < 1B parameters

alvations September 13, 2024, 10:31pm 2

Also asked on Reddit

Topic		Replies	Views
How to get a LLaMA v2 model with less than 7B parameters? Beginners	0	2126	August 24, 2023
Small LMs to prototype architecture experiments on Research	2	79	January 27, 2025
Looking for a Tiny LLM (max 1.5GB) – Need Advice Models	6	9283	December 6, 2024
Benchmarking LLMs 🤗Transformers	1	1437	August 20, 2024
Use BertLMHeadModel to finetunning a language model 🤗Transformers	0	325	March 30, 2021