Using device_map='auto' for training

Hi I am also curious about this – I want to first run inference and then add a few additional parameters to further finetune the models — is there any documentation/ tutorial on how to do that and/or with FSDP?

1 Like