I am currently using transformer pipeline to deploy a speech to text model. Model i am using is distil-whisper/small.en I am doing this to create a live speech to text engine and i am deploying the server on a gpu. The issue i am facing on gpu is that the ram usage is continously increasing and i…

Continous increase in Memory usage

xavier7778 November 26, 2024, 2:46pm 3

Actually i have tried the above approach but it is not freeing the memory

1 Like

Topic		Replies	Views
Continuous Memory Usage increasing 🤗Transformers	0	82	November 26, 2024
Clear GPU memory of transformers.pipeline Beginners	6	24120	March 19, 2025
Is there a way to terminate llm.generate and release the GPU memory for next prompt? DeepSpeed	1	161	February 4, 2025
Wav2vec2 not releasing memory after batch Models	1	469	May 22, 2023
Unable to free whole GPU memory even after ``del var; gc.collect; empty_cache()`` 🤗Transformers	8	587	September 26, 2024