The main page doesn’t make this very clear. I keep running out of CPU memory and I’m starting to think maybe deepspeed integration isn’t supposed to be supported?
Either that or my models aren’t getting deleted from the cpu perhaps.
The main page doesn’t make this very clear. I keep running out of CPU memory and I’m starting to think maybe deepspeed integration isn’t supposed to be supported?
Either that or my models aren’t getting deleted from the cpu perhaps.