My input sentence is very long(more than 512). What should I do when I want to fintune model about classify?Thanks

Beginners
2

Hey @ccfeidao you might want to try one of the dedicated models like LongFormer or BigBird which have a longer context size of around 4,096 tokens. See this thread for more details :slight_smile:

1 Like