How to prune albert model?

ck23 February 21, 2022, 11:27am 1

I am creating a model using albert transformer to retrain on a own corpus dataset. To increase the inference I need to prune the model. Is there a function to prune the weights or heads ?

Topic		Replies	Views
Training ALBERT from scratch with Distributed Training 🤗Transformers	0	1546	September 25, 2020
How to apply pruning on a BERT model? Beginners	5	2734	October 21, 2020
Error: 'AlbertModel' object has no attribute 'bias' -Trying to use custom corpus pretrained Albert chkpt 🤗Transformers	0	359	August 14, 2021
Pretraining ALBERT Intermediate	2	1203	February 16, 2022
How to prune a model trained with LayerDrop 🤗Transformers	0	316	April 11, 2022

How to prune albert model?

Related Topics