Why Tensorflow Models are way slower than Pytorch models, for autoregressive modeling?

[s4sarath]

@patrickvonplaten @sgugger For a simple greedy decoding in gpt2 small tensorflow is taking 7 seconds, while pytorch is taking less than a second.