How to reinit attention head

hi , i would like to reinit some specified head like L=10, H=3, how can i do that?

It depends on your model for the exact code, and the framework you want to use (PyTorch or TensorFlow) so more details would help us help you :slight_smile:

In general, you can access the layers as attributes of your model, so by picking the right layer through them, you should be able to reinit it.