I am try to use summarization model creating API using FastAPI. I set max ram which is 3GB and when call this API, it use full RAM then API stop working. Therefore API not working. Why this use much RAM? is there have any code error or any problem? I install despondency libraries and copy model to…

AWS Lambda + Transformers + Docker = use High RAM for summarization model

Indramal June 26, 2023, 2:39pm 2

Any answers?

Topic		Replies	Views
Output truncation of summaries models 🤗Transformers	0	442	March 30, 2023
Pretrained Models to Heroku Production Environment Beginners	5	1833	July 10, 2020
Which summarization model of huggingface supports more than 1024 tokens? Which model is more suitable for programming related articles? 🤗Transformers	1	1774	July 31, 2023
How to utilize a summarization model Beginners	4	2410	February 18, 2021
Google/pegasus-xsum for summerization is very slow Beginners	2	209	February 26, 2024