Hugging Face Forums
CPU Memory Usage with ‘low_cpu_mem_usage=True’ and ‘torch_dtype=“auto”’ flags
🤗Accelerate
hanguo
August 31, 2023, 11:51pm
3
Thanks for the response! What’s a good alternative channel for question like this?
show post in topic
Related topics
Topic
Replies
Views
Activity
LLaMA-2: CPU Memory Usage with ‘low_cpu_mem_usage=True’ and ‘torch_dtype=“auto”’ flags
🤗Transformers
0
3336
September 1, 2023
Double expected memory usage
Beginners
1
1423
August 17, 2022
The CPU memory usage becomes very small during model inference
🤗Transformers
0
53
November 30, 2024
Loading model directly to GPU omitting RAM
Beginners
6
93
March 28, 2025
GPU memory usage is twice (2x) what I calculated based on number of parameters and floating point precision
Intermediate
5
457
May 18, 2024