Compare the likelihood of various sentences in a LM?

Hi!

I have the beginning of a sentence (2-3 words) and couple candidate full sentences starting or ending with those words. Is there an easy way to use Transformers to know which of the full sentences was more likely to be output by a language model?

Hi Olivier,
What about comparing the average log-likelihoods of yours candidates?