Hi,
I am going through the huggingface lectures: Question answering.
When it was introducing the SQuad V2 dataset, In train-v2.0.json , there is only one answer for the question. While in dev-v2.0.json and hidden test-v2.0.json , there are several answers for a given question.
I did not understand why in the training set, there must be only one answer?
If there are multiple spans that share the exact same text as the correct answer, for example, if the correct answer is “20th century” and it is shown 3 times in the context. And in the training set, only the first place of “20th century” was annotated as “positive”.
I think this will make the model to be confused because even if it predicts the 2nd “20th century” in the context is positive, the loss function will tell it that is wrong.
Am I right?