I am creating a model using albert transformer to retrain on a own corpus dataset. To increase the inference I need to prune the model. Is there a function to prune the weights or heads ?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Training ALBERT from scratch with Distributed Training | 0 | 1702 | September 25, 2020 | |
| How to apply pruning on a BERT model? | 5 | 3336 | October 21, 2020 | |
| Albert LM on WikiText2 | 0 | 772 | July 27, 2020 | |
| How to Prune Transformer based Model? | 2 | 5376 | August 25, 2023 | |
| Is TFAlbert model pre-trainable? | 1 | 325 | July 15, 2020 |