Hey there!
I’m a bit rusty with my HuggingFace-fu, but I’ve done a bit with the transformers and datasets libraries over the years. I was wondering whether it is possible after using evaluate.load() to put the model that has been loaded onto a GPU? I’ve tried to use to on the object, and it doesn’t seem to work. I’m guessing the evaluate library is wrapping the model in a way that I can’t access the internals?
Specifically, I am utilizing the TOXICITY model on HuggingFace, using this line:
toxicity = evaluate.load("toxicity", module_type="measurement")
Any help would be appreciated! Thanks!