On Demand GPU model hosting?

I ran into a similar need and went with a lighter setup using a vps for mac just to manage some preprocessing before sending jobs to a heavier GPU instance. It helped cut costs since I didn’t need the GPU running all the time. You can script it to spin up the GPU server when needed and shut it down after, while keeping the mac vps always running in the background.

1 Like