Horovod Image for USing multi server

I am trying to use Horovod Library using pytorch , But I am not able to execute , I am getting error in transformer.trainer script , when i am passing optimizer . i am follwing the same format of code show by horovod docs page using pytorch , still not able to resolve. Any script u can show which uising horovod, so that i can modify one and retry .