import torch from transformers import AutoConfig, AutoTokenizer, BloomForCausalLM, AutoModelForCausalLM import time import psutil import gc def get_host_memory(): memory_allocated = round(psutil.Process().memory_info().rss / 1024**3, 3) print(“cpu”," memory used total: ", memory_allocated, “G…

Host memory still occupied after huggingface model deleted

leevan September 7, 2023, 5:52am 2

@sgugger could you help to check this quesiton? thank you!

Topic		Replies	Views
How do I release memory after using AutoModel.from_pretrained() to load model Beginners	5	803	September 24, 2024
Free up GPU memory after training is finished or interrupted (on Colab) 🤗Transformers	1	2479	May 30, 2024
Unable to free whole GPU memory even after ``del var; gc.collect; empty_cache()`` 🤗Transformers	8	640	September 26, 2024
AutoModel from_pretrained not releasing memory and causing a memory leak 🤗Transformers	7	7848	February 7, 2024
Loading of a model takes much RAM, passing to CUDA doesn't free RAM 🤗Transformers	0	775	August 8, 2021