Why Tensorflow Models are way slower than Pytorch models, for autoregressive modeling?

Hello!

The reason is because for now the TF models are not optimized for NLG, including the generate function, and we don’t recommend to use them for that task in production This is something we are working on, but cannot give you a specific date.

1 Like