this seems to be the correct implementation. I am adding the code below, please let me know if this is the right implementation.
Seems right implementation.
How can I pretrain T5 model?
Maybe like this.
1 Like