Beginner Question - How to distill a LLM

mrfakename · November 17, 2023, 2:26am

Hi, I had a beginner question: does HF Transformers have a way to distill a LLM w/ knowledge distillation? For example, could I make something like distilgpt2?
Thanks!

Topic		Replies	Views
Any tutorials for distilling (e.g. GPT2)? Beginners	1	489	August 29, 2021
Create your LLM model Beginners	0	303	March 28, 2024
How to fine-tune an LLM to support funciton calling Intermediate	0	546	November 15, 2023
Distillation for LongT5 Beginners	0	108	January 6, 2024
Create my LLM model Beginners	1	180	April 1, 2024

Beginner Question - How to distill a LLM

Related Topics