Hugging Face Forums
RAG Gradient Checking support
🤗Transformers
DeepSpeed
luka
December 8, 2021, 5:37pm
1
Does
RAG
support
Gradient Checking
? Or is there a simple way to using it in the
finetune script
?
Related topics
Topic
Replies
Views
Activity
RAG model doesn't have grad_fn on loss
Beginners
0
386
December 13, 2021
DeepSpeed and RayTune
Intermediate
0
542
September 26, 2021
Does Trainer hyperparameter search support deepspeed?
Beginners
0
214
July 10, 2023
Regarding RAG-end2end
Models
0
236
March 13, 2023
Regarding Rag-end2end retriever
🤗Transformers
1
227
January 31, 2023