Hi @ahomosapiens,
I posted a similar question related to the stopping criteria parameter (Stopping criteria BLOOM), but I haven’t received an answer yet… I would say that it is a problem with BLOOM because other models with the same parameters work correctly… I haven’t tried the use_gpu parameter, but I think that your code is correct.
I created a new discussion in the BLOOM community with regards to the stopping criteria parameter. If I get any response, I’ll let you know.
Cheers!