TrOCR as I know expects input as square image, though a line is a rectangular image. So when you really want to use it on a line, the performance is dropped. Try it yourself, Resize a full line text to a squared image and then you will see some noises