Which layers should be frozen and which ones should be left for fine-tune GIT?

I want a fine-tune GIT for captioning, which layers do I need to freeze?