I checked it, but didn’t find a way to use 8 cuda to use the second method which is about loading chunks of the model into multiple GPU to save memory
=> 1. Loading parts of a model onto each GPU and processing a single input at one time
I checked it, but didn’t find a way to use 8 cuda to use the second method which is about loading chunks of the model into multiple GPU to save memory
=> 1. Loading parts of a model onto each GPU and processing a single input at one time