How to take ensemble of T5ForConditionalGeneration?

I’m using T5ForConditionalGeneration for binary classification.
I run model.generate(input_ids) to get prediction.

The output text is actually binary label (yes/no) so I think I should be able to take average of several trials to get ensemble.
What are recommended ways to do this?
I would greatly appreciate any input. Thank you!

1 Like