BART for Multiple Choice

I wanted to use BART for multiple choice task such as SWAG. Usually, for translating from Sequence Classification to MultipleChoice, we obtain pooled representation from encoder. The BartModel returns the hidden states. Can anyone suggest what’s the recommended way to make it work after we get representation from encoder ?

3 Likes