Change Positional Embedding in T5 from Relative to Absolute

I would like to change the positional embedding in T5 from relative to absolute, anyone can direct me on an easy way of doing it or I need to dive in to the source code and change it?

1 Like