I am running inference using the pipeline api. But I get the following warning which recommends using the Dataset api. How can I do so? transformers4/lib/python3.8/site-packages/transformers/pipelines/base.py:899: UserWarning: You seem to be using the pipelines sequentially on GPU. In order to ma…

Pipeline inference with Dataset api

cameronw March 30, 2022, 6:26pm 3

I found the following help in the documentation, but I haven’t implemented yet because I’m just doing a POC with 50 documents. Sharing now in case it helps you get started!

1 Like

Topic		Replies	Views
Happytransformer Inference on dataset Beginners	1	699	January 31, 2023
Very low GPU usage when translating text, datasets not helping 🤗Transformers	3	5860	July 12, 2022
Error using datasets with pipeline for text generation 🤗Datasets	5	945	December 30, 2024
How to make single-input inference faster? Create my own pipeline? 🤗Transformers	9	3949	August 26, 2021
Progress bar for HF pipelines 🤗Transformers	9	18639	December 24, 2023

Pipeline inference with Dataset api

Related topics