How to modify the internal layers of BERT

[imflash217]

This works great. I can just create embeddings my way and call BERT with embeddings instead of ids…superb…Thanks a lot @Jung