Hi @oskrmiguel it depends on the Model. I did find this forum question that may help you find some insight into your question. Generation Probabilities: How to compute probabilities of output scores for GPT2 - #22 by Aktsvigun
Hi @oskrmiguel it depends on the Model. I did find this forum question that may help you find some insight into your question. Generation Probabilities: How to compute probabilities of output scores for GPT2 - #22 by Aktsvigun