I want to add L1-regularization on some weights in the transformer using the Trainer . Is it possible to do so ? Or would I have to mess with deeper layers of the api call ?

Is it possible to add L1-regularization in Huggingface Trainer?

nielsr September 11, 2024, 6:46am 2

Topic		Replies	Views
Trainer class optimization for transformer models Models	0	417	January 8, 2022
Using Huggingface Trainer for custom models Beginners	5	4063	May 29, 2023
Create a weighted loss function to handle imbalance? 🤗Transformers	3	203	February 3, 2025
Continued (in-domain) Pre-training of BART 🤗Transformers	1	457	September 13, 2023
Resources for using custom models with trainer Beginners	6	5292	April 6, 2021