Few shot text generation with T5 transformers like GPT-3

Hi HF team,

In a very interesting exploration, I explored the T5 transformer for few shot text generation just like GPT-3.
The results are impressive. Thought you might be interested in checking :slight_smile:


This looks impressive! Thanks for sharing :slight_smile:

1 Like

Very nice, thank you for writing the article and sharing it!

I noticed that you are using Transformers 2.9.0. Have you tried doing the same in more recent versions where a lot of the interface has changed? If so, were you successful or was that the reason you went back to an older version?

Hi @EdwinRijgersberg ! Thanks !
Since the last write-up, I adapted the code to use the latest HF and also Pytorch Lightning code.
You can check it out here:

1 Like