Pay attention to word(s)

I’m not sure if this is a dumb question but is it possible to change the importance of a word or the weight of the token of some kind so that the model will pay attention to a word more?

Basically i am trying to fine-tune a domain specific QA model but the prediction is often missing out on imporant words, i have around 5000 observations.