RAG Gradient Checking support

Does RAG support Gradient Checking? Or is there a simple way to using it in the finetune script?