I am creating a model using albert transformer to retrain on a own corpus dataset. To increase the inference I need to prune the model. Is there a function to prune the weights or heads ?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to apply pruning on a BERT model? | 5 | 3365 | October 21, 2020 | |
| Is it possible to freeze certain layer in ALBERT for Fine Tune? | 0 | 30 | December 24, 2024 | |
| ALBERT Pretraining example (Tensorflow) | 2 | 333 | November 23, 2020 | |
| Hugging Face Reads - 01/2021 - Sparsity and Pruning | 14 | 7499 | June 3, 2025 | |
| Error: 'AlbertModel' object has no attribute 'bias' -Trying to use custom corpus pretrained Albert chkpt | 0 | 384 | August 14, 2021 |