hi @squaadai ,
Gradio doesn’t handle multi-GPU processes. To distribute your inference across different GPUs, I recommend using Accelerate. We have a tutorial for you.
hi @squaadai ,
Gradio doesn’t handle multi-GPU processes. To distribute your inference across different GPUs, I recommend using Accelerate. We have a tutorial for you.