I am trying to use Horovod Library using pytorch , But I am not able to execute , I am getting error in transformer.trainer script , when i am passing optimizer . i am follwing the same format of code show by horovod docs page using pytorch , still not able to resolve. Any script u can show which uising horovod, so that i can modify one and retry .
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Error when fine-tuning with the Trainer API | 4 | 2602 | December 10, 2021 | |
| Distributed Training w/ Trainer | 8 | 8512 | May 31, 2022 | |
| Can you provide an example of best practices for incorporating a pretrained HuggingFace Vision Transformer (ViT) into a PyTorch Lightning module? | 0 | 44 | September 9, 2024 | |
| Using the Trainer API with a timm model | 0 | 245 | April 12, 2024 | |
| Early stop with Trainer API under Pytorch | 0 | 388 | July 16, 2021 |