I am creating a model using albert transformer to retrain on a own corpus dataset. To increase the inference I need to prune the model. Is there a function to prune the weights or heads ?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to apply pruning on a BERT model? | 5 | 3375 | October 21, 2020 | |
| ALBERT Pretraining example (Tensorflow) | 2 | 335 | November 23, 2020 | |
| Is TFAlbert model pre-trainable? | 1 | 328 | July 15, 2020 | |
| Cannot find pre-trained SOP head of ALBERT | 0 | 277 | October 22, 2020 | |
| Error: 'AlbertModel' object has no attribute 'bias' -Trying to use custom corpus pretrained Albert chkpt | 0 | 385 | August 14, 2021 |