I am running bloom with transformers with WSL2 using Ubuntu. Installed CUDA according to documentation and am able to train other AI/ML models which utilize CUDA. Why am I getting this error?
from transformers import pipeline
name = “bigscience/bloom-350m”
text = “Hello my name is”
max_new_tokens = 20
pipe = pipeline(model=name, model_kwargs= {“device_map”: “auto”, “load_in_8bit”: True}, max_new_tokens=20)
RuntimeError: Failed to import transformers.models.bloom.modeling_bloom because of the following error (look up to see its traceback):
CUDA exception! Error code: no CUDA-capable device is detected