Hi, I have tried BERT uncased model with Tensorflow and Pytorch but Pyt is slower . In pytorch if I increase the batch size to 512 the system gets hang. transformers 4.35.2 tensorflow 2.15.0 torch 2.1.1 Corresponding codes are in BERT model is slow in Pytorch · Issue #27756 · huggingface/transf…

BERT model is slow in Pytorch

Hakase-Noonna November 30, 2023, 5:21am 6

Hey, Would you check encoded_input in tensorflow script one more time?
I got the shape with (1,6). It should be same as pytorch shape (4, 512).
thx!

Topic		Replies	Views
Advice to speed and performance 🤗Transformers	4	7231	December 7, 2020
Make bert inference faster 🤗Transformers	6	10945	September 16, 2021
Large max differences between single input processing and batching with Bert and T5 🤗Transformers	0	555	April 26, 2021
Converting TF-Bert to Torch using conversion script works, but Beginners	4	768	July 23, 2021
Slow speed when using a fine-tuned bert for prediction Beginners	0	2168	March 26, 2022