New Layer in BERT

🤗Transformers
1

I would like to have a new layer in the middle of BERT-BASE i.e.,BERT-BASE has 12 encoder layers, I would like to place a new layer after 6 encoder layers and the output of custom layer need to be input for 7th encoder layer of bert.

How can I implement this in pretrained bert models.

Thanks in Advance