Hi all, I’m working with deepset/roberta-base-squad2 on accelerate for a while. It seems that in the past few weeks there are much more timeouts in the requests (i’m setting 10 seconds timeout).
To the point of getting consecutive timeouts call after call.
Any ideas on how to approach this?
Thank you!
Alex