@shamanez
Hi Shamanez,
I just want to change my generator from Bart (the original RAG architecture) to a T5-based generator. Normally, changing the generator gives out poor results.
Eg- Instead of generator= self.rag.generator
if I change the generator=Autotokenizer.From_pretrained(‘t5-small’) – This gives out bad results.
I have also changed the generator tokenizer in distributed_rag_retriever still no avail!!!
Need some hints or suggestions to change the generator from Bart-Large to T5 keeping other things intact.
Thanks !!!