Hugging Face Forums
Pytorch NLP model doesn’t use GPU when making inference
🤗Transformers
redrussianarmy
September 18, 2020, 1:27pm
5
Thank you valhalla. It works on GPU now.
show post in topic
Related topics
Topic
Replies
Views
Activity
Pipeline not using GPU
Beginners
0
1538
February 26, 2024
Using GPU with transformers
Beginners
4
11708
November 3, 2020
Need help performance issues transformers.AutoModelForCausalLM.from_pretrained( 'mosaicml/mpt-7b-instruct'
Beginners
0
934
June 12, 2023
Is Transformers using GPU by default?
Beginners
6
155300
December 11, 2023
NLP Pretrained model model doesn’t use GPU when making inference
🤗Transformers
11
10145
March 11, 2022