Hugging Face Forums

When does transformers support pipeline parallelism?

🤗Transformers

TurboPascal October 13, 2023, 8:48am 1

Will transformers support pipeline parallelism?

Topic		Replies	Views	Activity
Model Parallelism, how to parallelize transformer? Beginners	3	12647	June 18, 2021
How to parallelize model in order version 🤗Transformers	0	221	September 24, 2022
Tensor parallel in Pytorch 2.3 🤗Transformers	0	199	May 2, 2024
Are transformer pipelines re-entrant? Beginners	0	113	January 24, 2024
Does pipeline() support multithreading? I've tried various multithreaded calls and it still processes one sequentially before returning to the next Beginners	0	294	February 7, 2024