Hi, I’m trying to use T5-base model for summarization task using Inference API. I added the T5-specific prefix "summarize: " to the text. However, the model is returning translation_text as output instead of summary_text. (I was able to use t5-base model for summarization using a model and tokeniz…

Using T5-Base via Inference API

pierreguillou November 17, 2021, 6:40pm 2

Hello @mohsenalam. Did you solve your issue?
On my side, I would like to use Inferenec API for T5 base as well.
I opened this thread: How to get Accelerated Inference API for T5 models?

Topic		Replies	Views
T5 model for summarization far from SOTA results Models	0	1184	July 2, 2021
T5-base model create spelling mistake is summary 🤗Transformers	2	703	November 5, 2020
T5 Finetuning not converging Models	0	284	August 18, 2023
Finetune T5 with T5ForConditionalGeneration to multitask for Q&A and Summarization 🤗Transformers	0	286	November 28, 2023
<extra_id> when using fine-tuned MT5 for generation Beginners	9	2680	April 15, 2024