Why we add math to word embedding

🤗Transformers
1

During the positional encoding why we need to add some math results like sqrt tonword embedding part

Positional_encoding = word_embedding * sqrt + position_vector