I am running inference using the pipeline api. But I get the following warning which recommends using the Dataset api. How can I do so? transformers4/lib/python3.8/site-packages/transformers/pipelines/base.py:899: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to ma…

Pipeline inference with Dataset api

xiaobinbaby November 15, 2023, 4:12pm 6

Hi, I have met the same question. Run very slowly and present this warning. Is there any solution now?

Topic		Replies	Views
Happytransformer Inference on dataset Beginners	1	699	January 31, 2023
Very low GPU usage when translating text, datasets not helping 🤗Transformers	3	5860	July 12, 2022
Error using datasets with pipeline for text generation 🤗Datasets	5	945	December 30, 2024
How to make single-input inference faster? Create my own pipeline? 🤗Transformers	9	3949	August 26, 2021
Progress bar for HF pipelines 🤗Transformers	9	18637	December 24, 2023