I am trying to use Horovod Library using pytorch , But I am not able to execute , I am getting error in transformer.trainer script , when i am passing optimizer . i am follwing the same format of code show by horovod docs page using pytorch , still not able to resolve. Any script u can show which uising horovod, so that i can modify one and retry .
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Error when fine-tuning with the Trainer API | 4 | 2654 | December 10, 2021 | |
| Can you provide an example of best practices for incorporating a pretrained HuggingFace Vision Transformer (ViT) into a PyTorch Lightning module? | 0 | 62 | September 9, 2024 | |
| Using the Trainer API with a timm model | 0 | 251 | April 12, 2024 | |
| Early stop with Trainer API under Pytorch | 0 | 389 | July 16, 2021 | |
| How to train mnist with trainer? | 1 | 478 | December 7, 2023 |