I assume models like blenderbot need to look at prior inputs and outputs in order to form some consistency. How does the inference API provide that to the model?

How does the API inference work on models such as Blenderbot?

soni69 May 12, 2022, 11:11am 4

It works. Thanks

Topic		Replies	Views
Running blenderbot-3B locally does not produce same results as with inference API Beginners	2	444	March 28, 2022
Inference API detailed request Beginners	5	2319	September 11, 2020
Trouble Invoking GPU-Accelerated Inference Beginners	5	1467	October 3, 2022
Multi-turn dialogue using dialoGPT with Hosted Inference API Beginners	3	1081	July 31, 2020
Inference API works for flan-t5-xxl, but not for many other models I have tried with Jupyter/VSCode 🤗Transformers	0	381	June 15, 2023