Using the Trainer API with a timm model

I’m trying to use the Trainer API to finetune a timm model. I basically want to do peft/examples/image_classification/image_classification_timm_peft_lora.ipynb at main · huggingface/peft · GitHub but without having to write a custom pytorch training loop. I just want to use the Trainer API.

Is the best way to achieve this, simply to convert the timm model into a Pytorch model using this conversion script, and then upload it to the hub?