I’m trying to fine-tune T5 (ForConditionalGeneration) model with local files (added 3d attention mask in forward function of T5ForConditionalGeneration), and got error when the model evaluates, File “/home/paulc/customized_t5/models/custom_amr_to_sg/t5_model/modeling_t5.py”, line 568, in forward …

Matching output with shape in T5 model

debwol August 17, 2023, 11:57am 2

Did you find the bug?
Thanks in advance

Topic		Replies	Views
Errors in 3D attention mask for T5ForConditionalGeneration Beginners	0	537	December 31, 2022
Fine tune T5 hit error in predictions = np.argmax(predictions, axis=1) Beginners	1	614	February 5, 2024
Not enough values to unpack (expected 2, got 1) when training with T5ForConditionalGeneration Beginners	0	1336	August 24, 2022
How to train TFT5ForConditionalGeneration model? 🤗Transformers	5	3339	November 21, 2020
Error while generating more then one Beam output in T5 Intermediate	0	295	September 26, 2021