Hi everyone, I get an error when using BertTokenizer . I do encoding = tokenizer([[prompt, prompt, prompt], [choice0, choice1, choice2]], return_tensors='tf', padding=True)) and get ValueError: too many values to unpack (expected 2) . When I do encoding = tokenizer([[prompt, prompt], [choice0…

ValueError: too many values to unpack (expected 2) when using BertTokenizer

sgugger July 13, 2021, 2:47pm 6

You should look at the multiple choice exmaples (PyTorch only but the processing is the same) or the notebook that goes with it.

1 Like

Topic		Replies	Views
Evaluating multiple choices using BertForMultipleChoice Beginners	0	612	June 20, 2021
Encoding sentence pair with BERT cause ValueError: not enough values to unpack (expected 2, got 1) Beginners	1	6811	November 13, 2022
Unable to add additional choices to VisualBertForMultipleChoice, 🤗Transformers	1	174	March 28, 2024
Using `TFBertTokenizer` instead of `BertTokenizer` with `TFBertForQuestionAnswering` 🤗Tokenizers	1	1258	November 15, 2022
Bert Tokenizer Parameter Possible Values 🤗Transformers	0	250	October 8, 2021