Why Tensorflow Models are way slower than Pytorch models, for autoregressive modeling?

🤗Transformers
1

Hi,

I was experimenting with many models include GPT2, T5 etc. But it seems like Tensorflow models are too slow for same type of generation comparing to Tensorflow, whether it is greedy, beam etc .

Any specific reasons for this?

Thanks