Perhaps a naive question but what’s padding index in the transformers library and why a default value of -100 ?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Importance of padding for tokens and same size inputs for transformers | 1 | 660 | October 22, 2021 | |
Sequences shorter than model's input window size | 2 | 1149 | January 4, 2022 | |
CLIPVisionModel Padding Problem | 2 | 139 | November 18, 2024 | |
BERT embeddings for padding token not 0? | 4 | 4039 | February 14, 2022 | |
Padding in Decision Transformers Inference | 0 | 293 | May 22, 2023 |