@shamanez What is the recommended KB size to fine tune the context encoder of the RAG

🤗Transformers
1

Hi @@shamanez.

What is the recommended KB size to fine-tune the context encoder of the RAG?
Best,

2

Hi, sorry for the late reply. For some reason, I didn’t get the notification. You should be able to use something as large as Wikipedia dump. It depends on your computational power.

1 Like