HI @mengyahu, T5ForConditionalGeneration won’t return the generations, you need to call generate yourself to get the outs. When you pass labels it calculates the standard cross-entropy loss, here
T5ForConditionalGeneration
outs
labels
generate is defined here
generate