Hey there! I’m trying to solve a NER-like task, in which I have text tokens and labels for each token, in this form: ['i', 'want', 'to', 'fly', 'from', 'boston', 'at', '838', 'am', 'and', 'arrive', 'in', 'denver', 'at', '1110', 'in', 'the', 'morning'] ['O', 'O', 'O', 'O', 'O', 'O', 'B-fromloc.city_…

ValueError: Expected input batch_size to match target batch_size in Token Classification

Sandy1857 March 17, 2024, 7:39pm 8

Hi. Does AutomodelForTokenClassification instead of AutomodelForSequenceClassification solve the issue since you want to do Token Classification?

3 Likes

Topic		Replies	Views
ValueError: Expected input batch_size (8) to match target batch_size (280) Beginners	1	1977	November 18, 2024
ValueError: Target size (torch.Size([8])) must be the same as input size (torch.Size([8, 8])) Beginners	15	12619	January 9, 2025
ValueError: Expected input batch_size (16) to match target batch_size (64) Beginners	7	5066	November 7, 2023
Expected input batch_size (2048) to match target batch_size (4) Beginners	3	1609	May 23, 2022
Target size (torch.Size([8])) must be the same as input size (torch.Size([8, 2])) 🤗Transformers	5	5538	October 13, 2023