Say I want to train a simple LSTM or MLP with Trainer (Pytroch nn.Modules). Do I just need to ensure the model adheres to the following? [image] Is there an example of using Trainer to train models that are not HF Transformers models? Best practices?

Confirmed that you can train a simple LSTM or MLP with Trainer. This is nice since I can just stay within the HF ecosystem. I’m not sure I’ll have time to do a write-up but as long as you follow that list in the original post, it will work.

Using Huggingface Trainer for custom models

Beginners

kishore April 17, 2022, 2:48am 2

I think HF trainer API is specifically for transformers but not for other models.

Topic		Replies	Views
Training General Pytorch model with HuggingFace's Trainer 🤗Transformers	0	393	May 7, 2023
Resources for using custom models with trainer Beginners	6	5399	April 6, 2021
How to train mnist with trainer? 🤗Transformers	1	506	December 7, 2023
Using GRPOTrainer with a custom PyTorch module? 🤗Transformers	3	42	April 29, 2025
Using HF to train a custom PyTorch architecture Beginners	0	514	July 29, 2022

Using Huggingface Trainer for custom models

Related topics