Is there a way to retrieve the probabilities of the words retrieved in the multiple masks?
Since experimental support for multi-masking was recently added to the fill-mask pipeline, retrieving the score for each token is supported, although it is still unclear clear what the correct semantics should be. If you want to use the targets parameter, this is only supported in the single-mask case. @Lysandre goes into further details in the PR discussion.