Few shot text generation with T5 transformers like GPT-3

🤗Transformers
1

Hi HF team,

In a very interesting exploration, I explored the T5 transformer for few shot text generation just like GPT-3.
The results are impressive. Thought you might be interested in checking :slight_smile:
https://towardsdatascience.com/poor-mans-gpt-3-few-shot-text-generation-with-t5-transformer-51f1b01f843e?sk=5bb8f20ee72d55a91155289535ab26c5

6 Likes
2

This looks impressive! Thanks for sharing :slight_smile:

1 Like
3

Very nice, thank you for writing the article and sharing it!

I noticed that you are using Transformers 2.9.0. Have you tried doing the same in more recent versions where a lot of the interface has changed? If so, were you successful or was that the reason you went back to an older version?

4

Hi @EdwinRijgersberg ! Thanks !
Since the last write-up, I adapted the code to use the latest HF and also Pytorch Lightning code.
You can check it out here:

1 Like