Say I want to train a simple LSTM or MLP with Trainer (Pytroch nn.Modules). Do I just need to ensure the model adheres to the following? [image] Is there an example of using Trainer to train models that are not HF Transformers models? Best practices?

Confirmed that you can train a simple LSTM or MLP with Trainer. This is nice since I can just stay within the HF ecosystem. I’m not sure I’ll have time to do a write-up but as long as you follow that list in the original post, it will work.

Using Huggingface Trainer for custom models

Beginners

sgugger April 18, 2022, 12:25pm 3

We don’t have an example, but as long as you follow the recommendation in that list of the documentation, you should be fine.

1 Like

Topic		Replies	Views
Training General Pytorch model with HuggingFace's Trainer 🤗Transformers	0	393	May 7, 2023
Resources for using custom models with trainer Beginners	6	5399	April 6, 2021
How to train mnist with trainer? 🤗Transformers	1	506	December 7, 2023
Using GRPOTrainer with a custom PyTorch module? 🤗Transformers	3	42	April 29, 2025
Using HF to train a custom PyTorch architecture Beginners	0	514	July 29, 2022

Using Huggingface Trainer for custom models

Related topics