Hugging Face Forums
Loading quantized model on CPU only
๐คTransformers
chanansh
June 1, 2023, 7:19pm
2
I have a similar issue
AssertionError: Torch not compiled with CUDA enabled
show post in topic
Related Topics
Topic
Replies
Views
Activity
BLOOM models don't run on my GPU using Transformers
๐คTransformers
1
1479
September 18, 2022
How to avert 'loading checkpoint shards'?
๐คTransformers
1
5955
January 20, 2024
General question about large model loading
๐คAccelerate
1
601
June 13, 2023
How to debug if loading model caused pc to shutdown?
Beginners
0
43
April 19, 2024
CUDA Memory Error While Trying to Run Bloom Locally
Beginners
2
920
January 10, 2023