In the (Behind the pipeline - Hugging Face NLP Course) “behind the pipeline” part I think there is a mistake:
it needs to be
- Hidden size: The vector dimension of each model output.
instead of - Hidden size: The vector dimension of each model input.
Right?