I am currently using transformer pipeline to deploy a speech to text model. Model i am using is distil-whisper/small.en I am doing this to create a live speech to text engine and i am deploying the server on a gpu. The issue i am facing on gpu is that the ram usage is continously increasing and i…

Continous increase in Memory usage

John6666 November 27, 2024, 9:07am 9

Oh… what the heck

Topic		Replies	Views
Continuous Memory Usage increasing 🤗Transformers	0	82	November 26, 2024
Clear GPU memory of transformers.pipeline Beginners	6	24118	March 19, 2025
Is there a way to terminate llm.generate and release the GPU memory for next prompt? DeepSpeed	1	161	February 4, 2025
Wav2vec2 not releasing memory after batch Models	1	469	May 22, 2023
Unable to free whole GPU memory even after ``del var; gc.collect; empty_cache()`` 🤗Transformers	8	587	September 26, 2024